2026-02-25T14:14:01.933 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T14:14:01.948 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T14:14:02.027 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208 branch: tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '70208' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: c824a7fa29b067db9ce5a381f59b175918299919 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: c824a7fa29b067db9ce5a381f59b175918299919 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: tentacle sha1: c824a7fa29b067db9ce5a381f59b175918299919 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6877 sha1: c824a7fa29b067db9ce5a381f59b175918299919 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph_c824a7fa29b067db9ce5a381f59b175918299919/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: c824a7fa29b067db9ce5a381f59b175918299919 targets: trial021.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKDiHqE8h7zDRlDhGvguFwV2xxLr2qcI5ye5jHTyo2av1mwLPh4UJKUNatzvJGDVBUNjd3kanPAkY5XraKcIRI= trial031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8V4mEb0lNTSmJuEx8LceOK8l1ARJNkDRRlFlecSI+WJLMKcgf0l9aYMh49iIGa2w8eLY4JdmCmU1fX+0hADTg= trial068.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAnyZjgPEZSUMmOzmFgYB57Z5dXx7pNQ9iRdScMLednxk8gm4/sop3O+gVwpk4uFnOqZxHwHtKF9Pf1Gg57yq0= trial072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAkVK14dR8nY/gEe3167ZtfexVPxkGtJ4J2JxyHANNsBK2MV7okKgsXl9hJyeBGmPWU4eyxow0R+NRIKqRWQWE= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-25_14:08:21 tube: trial user: jayaprakash verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-25T14:14:02.028 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_c824a7fa29b067db9ce5a381f59b175918299919/qa; will attempt to use it 2026-02-25T14:14:02.028 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_c824a7fa29b067db9ce5a381f59b175918299919/qa/tasks 2026-02-25T14:14:02.028 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-25T14:14:02.030 INFO:teuthology.task.internal:Checking packages... 2026-02-25T14:14:02.030 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c824a7fa29b067db9ce5a381f59b175918299919' 2026-02-25T14:14:02.030 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T14:14:02.030 INFO:teuthology.packaging:ref: None 2026-02-25T14:14:02.030 INFO:teuthology.packaging:tag: None 2026-02-25T14:14:02.030 INFO:teuthology.packaging:branch: tentacle 2026-02-25T14:14:02.030 INFO:teuthology.packaging:sha1: c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:14:02.030 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=tentacle 2026-02-25T14:14:02.191 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-676.gc824a7fa 2026-02-25T14:14:02.193 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-25T14:14:02.204 INFO:teuthology.task.internal:no buildpackages task found 2026-02-25T14:14:02.204 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-25T14:14:02.216 INFO:teuthology.task.internal:Saving configuration 2026-02-25T14:14:02.237 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-25T14:14:02.249 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-25T14:14:02.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial021.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:10:30.748472', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKDiHqE8h7zDRlDhGvguFwV2xxLr2qcI5ye5jHTyo2av1mwLPh4UJKUNatzvJGDVBUNjd3kanPAkY5XraKcIRI='} 2026-02-25T14:14:02.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial031.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:10:30.748084', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8V4mEb0lNTSmJuEx8LceOK8l1ARJNkDRRlFlecSI+WJLMKcgf0l9aYMh49iIGa2w8eLY4JdmCmU1fX+0hADTg='} 2026-02-25T14:14:02.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial068.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:10:30.747666', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAnyZjgPEZSUMmOzmFgYB57Z5dXx7pNQ9iRdScMLednxk8gm4/sop3O+gVwpk4uFnOqZxHwHtKF9Pf1Gg57yq0='} 2026-02-25T14:14:02.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial072.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 14:10:30.746926', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAkVK14dR8nY/gEe3167ZtfexVPxkGtJ4J2JxyHANNsBK2MV7okKgsXl9hJyeBGmPWU4eyxow0R+NRIKqRWQWE='} 2026-02-25T14:14:02.517 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-25T14:14:02.529 INFO:teuthology.task.internal:roles: ubuntu@trial021.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-25T14:14:02.529 INFO:teuthology.task.internal:roles: ubuntu@trial031.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-25T14:14:02.529 INFO:teuthology.task.internal:roles: ubuntu@trial068.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-25T14:14:02.529 INFO:teuthology.task.internal:roles: ubuntu@trial072.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-25T14:14:02.529 INFO:teuthology.run_tasks:Running task console_log... 2026-02-25T14:14:02.789 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7e07917f3240>, signals=[15]) 2026-02-25T14:14:02.789 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-25T14:14:02.802 INFO:teuthology.task.internal:Opening connections... 2026-02-25T14:14:02.802 DEBUG:teuthology.task.internal:connecting to ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:14:02.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:14:02.863 DEBUG:teuthology.task.internal:connecting to ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:14:02.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:14:02.926 DEBUG:teuthology.task.internal:connecting to ubuntu@trial068.front.sepia.ceph.com 2026-02-25T14:14:02.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:14:02.988 DEBUG:teuthology.task.internal:connecting to ubuntu@trial072.front.sepia.ceph.com 2026-02-25T14:14:02.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:14:03.048 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-25T14:14:03.057 DEBUG:teuthology.orchestra.run.trial021:> uname -m 2026-02-25T14:14:03.072 INFO:teuthology.orchestra.run.trial021.stdout:x86_64 2026-02-25T14:14:03.073 DEBUG:teuthology.orchestra.run.trial021:> cat /etc/os-release 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:NAME="CentOS Stream" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:VERSION="9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:ID="centos" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:VERSION_ID="9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:ANSI_COLOR="0;31" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:14:03.128 INFO:teuthology.orchestra.run.trial021.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:14:03.129 INFO:teuthology.lock.ops:Updating trial021.front.sepia.ceph.com on lock server 2026-02-25T14:14:03.198 DEBUG:teuthology.orchestra.run.trial031:> uname -m 2026-02-25T14:14:03.214 INFO:teuthology.orchestra.run.trial031.stdout:x86_64 2026-02-25T14:14:03.214 DEBUG:teuthology.orchestra.run.trial031:> cat /etc/os-release 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:NAME="CentOS Stream" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:VERSION="9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:ID="centos" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:VERSION_ID="9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:ANSI_COLOR="0;31" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:14:03.269 INFO:teuthology.orchestra.run.trial031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:14:03.270 INFO:teuthology.lock.ops:Updating trial031.front.sepia.ceph.com on lock server 2026-02-25T14:14:03.345 DEBUG:teuthology.orchestra.run.trial068:> uname -m 2026-02-25T14:14:03.360 INFO:teuthology.orchestra.run.trial068.stdout:x86_64 2026-02-25T14:14:03.360 DEBUG:teuthology.orchestra.run.trial068:> cat /etc/os-release 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:NAME="CentOS Stream" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:VERSION="9" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:ID="centos" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:VERSION_ID="9" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:ANSI_COLOR="0;31" 2026-02-25T14:14:03.416 INFO:teuthology.orchestra.run.trial068.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:14:03.417 INFO:teuthology.orchestra.run.trial068.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:14:03.417 INFO:teuthology.orchestra.run.trial068.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:14:03.417 INFO:teuthology.orchestra.run.trial068.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:14:03.417 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:14:03.417 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:14:03.417 INFO:teuthology.lock.ops:Updating trial068.front.sepia.ceph.com on lock server 2026-02-25T14:14:03.501 DEBUG:teuthology.orchestra.run.trial072:> uname -m 2026-02-25T14:14:03.516 INFO:teuthology.orchestra.run.trial072.stdout:x86_64 2026-02-25T14:14:03.516 DEBUG:teuthology.orchestra.run.trial072:> cat /etc/os-release 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:NAME="CentOS Stream" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:VERSION="9" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:ID="centos" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:ID_LIKE="rhel fedora" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:VERSION_ID="9" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:PLATFORM_ID="platform:el9" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:ANSI_COLOR="0;31" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:LOGO="fedora-logo-icon" 2026-02-25T14:14:03.571 INFO:teuthology.orchestra.run.trial072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T14:14:03.572 INFO:teuthology.orchestra.run.trial072.stdout:HOME_URL="https://centos.org/" 2026-02-25T14:14:03.572 INFO:teuthology.orchestra.run.trial072.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T14:14:03.572 INFO:teuthology.orchestra.run.trial072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T14:14:03.572 INFO:teuthology.orchestra.run.trial072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T14:14:03.572 INFO:teuthology.lock.ops:Updating trial072.front.sepia.ceph.com on lock server 2026-02-25T14:14:03.652 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-25T14:14:03.666 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-25T14:14:03.678 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-25T14:14:03.678 DEBUG:teuthology.orchestra.run.trial021:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:14:03.679 DEBUG:teuthology.orchestra.run.trial031:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:14:03.681 DEBUG:teuthology.orchestra.run.trial068:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:14:03.683 DEBUG:teuthology.orchestra.run.trial072:> test '!' -e /home/ubuntu/cephtest 2026-02-25T14:14:03.698 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-25T14:14:03.709 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-25T14:14:03.709 DEBUG:teuthology.orchestra.run.trial021:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:14:03.735 DEBUG:teuthology.orchestra.run.trial031:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:14:03.737 DEBUG:teuthology.orchestra.run.trial068:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:14:03.739 DEBUG:teuthology.orchestra.run.trial072:> test -z $(ls -A /var/lib/ceph) 2026-02-25T14:14:03.757 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-25T14:14:04.038 INFO:teuthology.run_tasks:Running task kernel... 2026-02-25T14:14:04.057 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-25T14:14:04.057 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-25T14:14:04.058 DEBUG:teuthology.orchestra.run.trial021:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:14:04.058 DEBUG:teuthology.orchestra.run.trial031:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:14:04.058 DEBUG:teuthology.orchestra.run.trial068:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:14:04.058 DEBUG:teuthology.orchestra.run.trial072:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T14:14:04.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:14:04.072 DEBUG:teuthology.orchestra.run.trial021:> uname -r 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run.trial068:> uname -r 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run.trial072:> uname -r 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:14:04.073 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-25T14:14:04.128 INFO:teuthology.orchestra.run.trial068.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:14:04.128 INFO:teuthology.task.kernel:Running kernel on trial068: 5.14.0-681.el9.x86_64 2026-02-25T14:14:04.128 DEBUG:teuthology.orchestra.run.trial068:> sudo yum install -y kernel 2026-02-25T14:14:04.128 INFO:teuthology.orchestra.run.trial072.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:14:04.128 INFO:teuthology.orchestra.run.trial021.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:14:04.129 INFO:teuthology.task.kernel:Running kernel on trial072: 5.14.0-681.el9.x86_64 2026-02-25T14:14:04.129 DEBUG:teuthology.orchestra.run.trial072:> sudo yum install -y kernel 2026-02-25T14:14:04.129 INFO:teuthology.task.kernel:Running kernel on trial021: 5.14.0-681.el9.x86_64 2026-02-25T14:14:04.129 DEBUG:teuthology.orchestra.run.trial021:> sudo yum install -y kernel 2026-02-25T14:14:04.129 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-681.el9.x86_64 2026-02-25T14:14:04.129 INFO:teuthology.task.kernel:Running kernel on trial031: 5.14.0-681.el9.x86_64 2026-02-25T14:14:04.129 DEBUG:teuthology.orchestra.run.trial031:> sudo yum install -y kernel 2026-02-25T14:14:05.246 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-25T14:14:05.496 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.9 MB 00:00 2026-02-25T14:14:05.886 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-25T14:14:06.254 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.9 MB 00:01 2026-02-25T14:14:08.436 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-25T14:14:08.584 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-25T14:14:09.686 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 27 MB 00:02 2026-02-25T14:14:09.898 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 27 MB 00:03 2026-02-25T14:14:11.205 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - CRB 23 MB/s | 8.0 MB 00:00 2026-02-25T14:14:12.398 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-25T14:14:12.658 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 8.0 MB 00:01 2026-02-25T14:14:13.260 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 8.0 MB 00:00 2026-02-25T14:14:13.612 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 20 kB 00:00 2026-02-25T14:14:13.675 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 8.0 MB 00:01 2026-02-25T14:14:14.047 INFO:teuthology.orchestra.run.trial072.stdout:Extra Packages for Enterprise Linux 55 MB/s | 20 MB 00:00 2026-02-25T14:14:14.051 INFO:teuthology.orchestra.run.trial068.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-25T14:14:14.147 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - Extras packages 137 kB/s | 20 kB 00:00 2026-02-25T14:14:15.446 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-25T14:14:15.562 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-25T14:14:16.232 INFO:teuthology.orchestra.run.trial021.stdout:Extra Packages for Enterprise Linux 28 MB/s | 20 MB 00:00 2026-02-25T14:14:17.258 INFO:teuthology.orchestra.run.trial072.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T14:14:17.262 INFO:teuthology.orchestra.run.trial068.stdout:lab-extras 2.9 MB/s | 50 kB 00:00 2026-02-25T14:14:18.267 INFO:teuthology.orchestra.run.trial072.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:14:18.267 INFO:teuthology.orchestra.run.trial072.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:14:18.269 INFO:teuthology.orchestra.run.trial068.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:14:18.269 INFO:teuthology.orchestra.run.trial068.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:14:18.287 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:14:18.288 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:14:18.289 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:14:18.290 INFO:teuthology.orchestra.run.trial072.stdout:Install 4 Packages 2026-02-25T14:14:18.290 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:18.290 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 89 M 2026-02-25T14:14:18.290 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 135 M 2026-02-25T14:14:18.290 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:14:18.291 INFO:teuthology.orchestra.run.trial068.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:Install 4 Packages 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 89 M 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 135 M 2026-02-25T14:14:18.292 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:14:18.617 INFO:teuthology.orchestra.run.trial072.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 3.7 MB/s | 901 kB 00:00 2026-02-25T14:14:18.767 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-25T14:14:18.944 INFO:teuthology.orchestra.run.trial072.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 30 MB/s | 17 MB 00:00 2026-02-25T14:14:18.993 INFO:teuthology.orchestra.run.trial068.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.4 MB/s | 901 kB 00:00 2026-02-25T14:14:19.268 INFO:teuthology.orchestra.run.trial072.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 48 MB/s | 31 MB 00:00 2026-02-25T14:14:19.337 INFO:teuthology.orchestra.run.trial072.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 41 MB/s | 40 MB 00:00 2026-02-25T14:14:19.337 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:14:19.337 INFO:teuthology.orchestra.run.trial072.stdout:Total 85 MB/s | 89 MB 00:01 2026-02-25T14:14:19.372 INFO:teuthology.orchestra.run.trial021.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T14:14:19.527 INFO:teuthology.orchestra.run.trial068.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 15 MB/s | 17 MB 00:01 2026-02-25T14:14:19.534 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:14:19.736 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:14:19.736 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:14:19.791 INFO:teuthology.orchestra.run.trial031.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:14:19.791 INFO:teuthology.orchestra.run.trial031.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:14:19.811 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:14:19.812 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:Install 4 Packages 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 89 M 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 135 M 2026-02-25T14:14:19.813 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:14:20.057 INFO:teuthology.orchestra.run.trial068.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-25T14:14:20.120 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:14:20.121 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:14:20.161 INFO:teuthology.orchestra.run.trial031.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 3.0 MB/s | 901 kB 00:00 2026-02-25T14:14:20.216 INFO:teuthology.orchestra.run.trial068.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-25T14:14:20.216 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:14:20.216 INFO:teuthology.orchestra.run.trial068.stdout:Total 46 MB/s | 89 MB 00:01 2026-02-25T14:14:20.376 INFO:teuthology.orchestra.run.trial021.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T14:14:20.376 INFO:teuthology.orchestra.run.trial021.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T14:14:20.396 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout: Package Architecture Version Repository Size 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T14:14:20.397 INFO:teuthology.orchestra.run.trial021.stdout:Installing dependencies: 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:Install 4 Packages 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 89 M 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 135 M 2026-02-25T14:14:20.398 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:14:20.405 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:14:20.612 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:14:20.613 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:14:20.788 INFO:teuthology.orchestra.run.trial031.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 19 MB/s | 17 MB 00:00 2026-02-25T14:14:20.998 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:14:20.998 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:14:21.151 INFO:teuthology.orchestra.run.trial031.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 31 MB/s | 40 MB 00:01 2026-02-25T14:14:21.233 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:14:21.298 INFO:teuthology.orchestra.run.trial031.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 27 MB/s | 31 MB 00:01 2026-02-25T14:14:21.298 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:14:21.299 INFO:teuthology.orchestra.run.trial031.stdout:Total 60 MB/s | 89 MB 00:01 2026-02-25T14:14:21.339 INFO:teuthology.orchestra.run.trial021.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.4 MB/s | 901 kB 00:00 2026-02-25T14:14:21.491 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:14:21.522 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:21.544 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:21.694 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:14:21.694 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:14:21.892 INFO:teuthology.orchestra.run.trial021.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 14 MB/s | 17 MB 00:01 2026-02-25T14:14:22.078 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:14:22.078 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:14:22.107 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:14:22.396 INFO:teuthology.orchestra.run.trial068.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:22.405 INFO:teuthology.orchestra.run.trial021.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 29 MB/s | 31 MB 00:01 2026-02-25T14:14:22.418 INFO:teuthology.orchestra.run.trial068.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:22.611 INFO:teuthology.orchestra.run.trial021.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 21 MB/s | 40 MB 00:01 2026-02-25T14:14:22.611 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:14:22.612 INFO:teuthology.orchestra.run.trial021.stdout:Total 40 MB/s | 89 MB 00:02 2026-02-25T14:14:22.801 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:14:22.999 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:14:22.999 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:14:23.191 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:14:23.380 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:14:23.381 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:14:23.485 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:23.507 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:24.125 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:24.158 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:24.489 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:14:24.779 INFO:teuthology.orchestra.run.trial021.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:24.801 INFO:teuthology.orchestra.run.trial021.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:24.990 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:25.023 INFO:teuthology.orchestra.run.trial068.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:26.061 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:26.095 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:27.199 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:27.205 INFO:teuthology.orchestra.run.trial072.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:27.353 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:27.386 INFO:teuthology.orchestra.run.trial021.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:28.124 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:28.130 INFO:teuthology.orchestra.run.trial068.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:29.201 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:29.207 INFO:teuthology.orchestra.run.trial031.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:30.263 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:30.420 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:30.428 INFO:teuthology.orchestra.run.trial021.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:31.177 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:32.258 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:33.482 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:47.958 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:47.980 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.165 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.166 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:48.166 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:48.166 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:48.222 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.222 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:48.223 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:14:48.285 DEBUG:teuthology.orchestra.run.trial072:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:48.313 INFO:teuthology.orchestra.run.trial072.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.315 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:48.315 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:14:48.315 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:14:48.315 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:14:48.315 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-25T14:14:48.315 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial072.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:14:48.316 DEBUG:teuthology.orchestra.run.trial072:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:48.383 INFO:teuthology.orchestra.run.trial072.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.383 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:48.383 DEBUG:teuthology.orchestra.run.trial072:> sudo rpm -qi grub2-tools 2026-02-25T14:14:48.453 INFO:teuthology.orchestra.run.trial072.stdout:Name : grub2-tools 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Epoch : 1 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Version : 2.06 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Release : 120.el9 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Architecture: x86_64 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Group : Unspecified 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Size : 9108611 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:License : GPLv3+ 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:14:48.454 INFO:teuthology.orchestra.run.trial072.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Packager : builder@centos.org 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Vendor : CentOS 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Summary : Support tools for GRUB. 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:Description : 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:14:48.455 INFO:teuthology.orchestra.run.trial072.stdout:hardware devices. 2026-02-25T14:14:48.456 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:14:48.456 INFO:teuthology.orchestra.run.trial072.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:14:48.457 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:14:48.457 INFO:teuthology.task.kernel:Updating grub on trial072 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:14:48.457 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:14:48.521 INFO:teuthology.orchestra.run.trial072.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:14:48.523 DEBUG:teuthology.orchestra.run.trial072:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:14:48.586 INFO:teuthology.orchestra.run.trial072.stdout:/sbin/grubby 2026-02-25T14:14:48.588 INFO:teuthology.orchestra.run.trial072.stdout:yes 2026-02-25T14:14:48.588 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:14:48.652 INFO:teuthology.orchestra.run.trial072.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:14:48.653 DEBUG:teuthology.orchestra.run.trial072:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.684 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.706 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.726 DEBUG:teuthology.orchestra.run.trial072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:14:48.893 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.893 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:48.894 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:48.894 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:48.931 INFO:teuthology.orchestra.run.trial072.stderr:Generating grub configuration file ... 2026-02-25T14:14:48.950 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:48.951 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:14:48.999 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:14:49.005 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:14:49.012 DEBUG:teuthology.orchestra.run.trial068:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:49.041 INFO:teuthology.orchestra.run.trial068.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:49.042 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:49.042 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:14:49.042 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:14:49.042 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:14:49.043 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-25T14:14:49.043 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial068.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:14:49.043 DEBUG:teuthology.orchestra.run.trial068:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:49.109 INFO:teuthology.orchestra.run.trial068.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:49.109 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:49.110 DEBUG:teuthology.orchestra.run.trial068:> sudo rpm -qi grub2-tools 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Name : grub2-tools 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Epoch : 1 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Version : 2.06 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Release : 120.el9 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Architecture: x86_64 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Group : Unspecified 2026-02-25T14:14:49.178 INFO:teuthology.orchestra.run.trial068.stdout:Size : 9108611 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:License : GPLv3+ 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Packager : builder@centos.org 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Vendor : CentOS 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Summary : Support tools for GRUB. 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:Description : 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:49.179 INFO:teuthology.orchestra.run.trial068.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:14:49.180 INFO:teuthology.orchestra.run.trial068.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:14:49.180 INFO:teuthology.orchestra.run.trial068.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:14:49.180 INFO:teuthology.orchestra.run.trial068.stdout:hardware devices. 2026-02-25T14:14:49.180 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:14:49.180 INFO:teuthology.orchestra.run.trial068.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:14:49.181 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:14:49.181 INFO:teuthology.task.kernel:Updating grub on trial068 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:14:49.181 DEBUG:teuthology.orchestra.run.trial068:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:14:49.243 INFO:teuthology.orchestra.run.trial068.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:14:49.245 DEBUG:teuthology.orchestra.run.trial068:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:14:49.258 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:14:49.265 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:14:49.299 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:14:49.305 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:14:49.309 INFO:teuthology.orchestra.run.trial068.stdout:/sbin/grubby 2026-02-25T14:14:49.311 INFO:teuthology.orchestra.run.trial068.stdout:yes 2026-02-25T14:14:49.311 DEBUG:teuthology.orchestra.run.trial068:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:14:49.336 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:14:49.343 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:14:49.367 INFO:teuthology.orchestra.run.trial072.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:14:49.373 INFO:teuthology.orchestra.run.trial072.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:14:49.375 INFO:teuthology.orchestra.run.trial068.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:14:49.376 DEBUG:teuthology.orchestra.run.trial068:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:14:49.448 DEBUG:teuthology.orchestra.run.trial068:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:14:49.458 INFO:teuthology.orchestra.run.trial072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:14:49.467 INFO:teuthology.orchestra.run.trial072.stderr:done 2026-02-25T14:14:49.468 DEBUG:teuthology.orchestra.run.trial072:> test -d /sys/firmware/efi 2026-02-25T14:14:49.485 DEBUG:teuthology.orchestra.run.trial072:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:14:49.550 INFO:teuthology.orchestra.run.trial072.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:14:49.550 INFO:teuthology.orchestra.run.trial072.stdout:/boot/efi/EFI/centos 2026-02-25T14:14:49.552 DEBUG:teuthology.orchestra.run.trial072:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:14:49.617 INFO:teuthology.orchestra.run.trial072.stdout:no 2026-02-25T14:14:49.618 DEBUG:teuthology.orchestra.run.trial072:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:14:49.654 INFO:teuthology.orchestra.run.trial068.stderr:Generating grub configuration file ... 2026-02-25T14:14:49.681 INFO:teuthology.orchestra.run.trial072.stdout:yes 2026-02-25T14:14:49.682 DEBUG:teuthology.orchestra.run.trial072:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:14:49.720 INFO:teuthology.orchestra.run.trial068.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:14:49.727 INFO:teuthology.orchestra.run.trial068.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:14:49.746 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial072 2026-02-25T14:14:49.747 DEBUG:teuthology.orchestra.run.trial072:> sudo bash -c ' 2026-02-25T14:14:49.747 DEBUG:teuthology.orchestra.run.trial072:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:14:49.747 DEBUG:teuthology.orchestra.run.trial072:> ' 2026-02-25T14:14:49.855 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:49.878 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:49.980 INFO:teuthology.orchestra.run.trial068.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:14:49.987 INFO:teuthology.orchestra.run.trial068.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:14:50.022 INFO:teuthology.orchestra.run.trial068.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:14:50.028 INFO:teuthology.orchestra.run.trial068.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:14:50.060 INFO:teuthology.orchestra.run.trial068.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:14:50.066 INFO:teuthology.orchestra.run.trial068.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:14:50.067 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:50.067 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:50.067 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:50.067 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:50.089 INFO:teuthology.orchestra.run.trial068.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:14:50.095 INFO:teuthology.orchestra.run.trial068.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:14:50.124 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:50.124 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:50.124 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:50.125 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:14:50.181 INFO:teuthology.orchestra.run.trial068.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:14:50.187 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:50.190 INFO:teuthology.orchestra.run.trial068.stderr:done 2026-02-25T14:14:50.192 DEBUG:teuthology.orchestra.run.trial068:> test -d /sys/firmware/efi 2026-02-25T14:14:50.208 DEBUG:teuthology.orchestra.run.trial068:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:14:50.216 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.217 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:50.218 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:14:50.218 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:14:50.218 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:14:50.218 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-25T14:14:50.218 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial031.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:14:50.218 DEBUG:teuthology.orchestra.run.trial031:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:50.272 INFO:teuthology.orchestra.run.trial068.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:14:50.272 INFO:teuthology.orchestra.run.trial068.stdout:/boot/efi/EFI/centos 2026-02-25T14:14:50.274 DEBUG:teuthology.orchestra.run.trial068:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:14:50.283 INFO:teuthology.orchestra.run.trial031.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:50.284 DEBUG:teuthology.orchestra.run.trial031:> sudo rpm -qi grub2-tools 2026-02-25T14:14:50.338 INFO:teuthology.orchestra.run.trial068.stdout:no 2026-02-25T14:14:50.339 DEBUG:teuthology.orchestra.run.trial068:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Name : grub2-tools 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Epoch : 1 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Version : 2.06 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Release : 120.el9 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Architecture: x86_64 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Group : Unspecified 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Size : 9108611 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:License : GPLv3+ 2026-02-25T14:14:50.353 INFO:teuthology.orchestra.run.trial031.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Packager : builder@centos.org 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Vendor : CentOS 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Summary : Support tools for GRUB. 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:Description : 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:14:50.354 INFO:teuthology.orchestra.run.trial031.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:14:50.355 INFO:teuthology.orchestra.run.trial031.stdout:hardware devices. 2026-02-25T14:14:50.355 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:14:50.355 INFO:teuthology.orchestra.run.trial031.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:14:50.356 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:14:50.356 INFO:teuthology.task.kernel:Updating grub on trial031 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:14:50.356 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:14:50.404 INFO:teuthology.orchestra.run.trial068.stdout:yes 2026-02-25T14:14:50.405 DEBUG:teuthology.orchestra.run.trial068:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:14:50.420 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:14:50.422 DEBUG:teuthology.orchestra.run.trial031:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:14:50.469 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial068 2026-02-25T14:14:50.469 DEBUG:teuthology.orchestra.run.trial068:> sudo bash -c ' 2026-02-25T14:14:50.469 DEBUG:teuthology.orchestra.run.trial068:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:14:50.469 DEBUG:teuthology.orchestra.run.trial068:> ' 2026-02-25T14:14:50.486 INFO:teuthology.orchestra.run.trial031.stdout:/sbin/grubby 2026-02-25T14:14:50.487 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-25T14:14:50.488 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:14:50.551 INFO:teuthology.orchestra.run.trial031.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:14:50.552 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.625 DEBUG:teuthology.orchestra.run.trial031:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:14:50.832 INFO:teuthology.orchestra.run.trial031.stderr:Generating grub configuration file ... 2026-02-25T14:14:50.899 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:14:50.906 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:14:50.920 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:50.942 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:51.128 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:51.128 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T14:14:51.129 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T14:14:51.129 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T14:14:51.154 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:14:51.161 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:14:51.187 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T14:14:51.187 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:51.188 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:14:51.195 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:14:51.202 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:14:51.234 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:14:51.241 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:14:51.251 DEBUG:teuthology.orchestra.run.trial021:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:51.264 INFO:teuthology.orchestra.run.trial031.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:14:51.270 INFO:teuthology.orchestra.run.trial031.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:14:51.279 INFO:teuthology.orchestra.run.trial021.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.279 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:51.279 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T14:14:51.280 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T14:14:51.280 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T14:14:51.280 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-25T14:14:51.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial021.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T14:14:51.280 DEBUG:teuthology.orchestra.run.trial021:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T14:14:51.344 INFO:teuthology.orchestra.run.trial021.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T14:14:51.345 DEBUG:teuthology.orchestra.run.trial021:> sudo rpm -qi grub2-tools 2026-02-25T14:14:51.355 INFO:teuthology.orchestra.run.trial031.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:14:51.364 INFO:teuthology.orchestra.run.trial031.stderr:done 2026-02-25T14:14:51.366 DEBUG:teuthology.orchestra.run.trial031:> test -d /sys/firmware/efi 2026-02-25T14:14:51.383 DEBUG:teuthology.orchestra.run.trial031:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Name : grub2-tools 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Epoch : 1 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Version : 2.06 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Release : 120.el9 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Architecture: x86_64 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T14:14:51.413 INFO:teuthology.orchestra.run.trial021.stdout:Group : Unspecified 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Size : 9108611 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:License : GPLv3+ 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Packager : builder@centos.org 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Vendor : CentOS 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Summary : Support tools for GRUB. 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout:Description : 2026-02-25T14:14:51.414 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout:hardware devices. 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:14:51.415 INFO:teuthology.orchestra.run.trial021.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T14:14:51.416 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T14:14:51.416 INFO:teuthology.task.kernel:Updating grub on trial021 to boot 5.14.0-686.el9.x86_64 2026-02-25T14:14:51.416 DEBUG:teuthology.orchestra.run.trial021:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T14:14:51.447 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:14:51.447 INFO:teuthology.orchestra.run.trial031.stdout:/boot/efi/EFI/centos 2026-02-25T14:14:51.449 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:14:51.481 INFO:teuthology.orchestra.run.trial021.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T14:14:51.482 DEBUG:teuthology.orchestra.run.trial021:> sudo command -v grubby && echo yes || echo no 2026-02-25T14:14:51.516 INFO:teuthology.orchestra.run.trial031.stdout:no 2026-02-25T14:14:51.517 DEBUG:teuthology.orchestra.run.trial031:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:14:51.547 INFO:teuthology.orchestra.run.trial021.stdout:/sbin/grubby 2026-02-25T14:14:51.549 INFO:teuthology.orchestra.run.trial021.stdout:yes 2026-02-25T14:14:51.549 DEBUG:teuthology.orchestra.run.trial021:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T14:14:51.580 INFO:teuthology.orchestra.run.trial031.stdout:yes 2026-02-25T14:14:51.580 DEBUG:teuthology.orchestra.run.trial031:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:14:51.611 INFO:teuthology.orchestra.run.trial021.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T14:14:51.613 DEBUG:teuthology.orchestra.run.trial021:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.644 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial031 2026-02-25T14:14:51.645 DEBUG:teuthology.orchestra.run.trial031:> sudo bash -c ' 2026-02-25T14:14:51.645 DEBUG:teuthology.orchestra.run.trial031:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:14:51.645 DEBUG:teuthology.orchestra.run.trial031:> ' 2026-02-25T14:14:51.686 DEBUG:teuthology.orchestra.run.trial021:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T14:14:51.891 INFO:teuthology.orchestra.run.trial021.stderr:Generating grub configuration file ... 2026-02-25T14:14:51.957 INFO:teuthology.orchestra.run.trial021.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T14:14:51.964 INFO:teuthology.orchestra.run.trial021.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T14:14:52.211 INFO:teuthology.orchestra.run.trial021.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T14:14:52.218 INFO:teuthology.orchestra.run.trial021.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T14:14:52.252 INFO:teuthology.orchestra.run.trial021.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T14:14:52.259 INFO:teuthology.orchestra.run.trial021.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T14:14:52.290 INFO:teuthology.orchestra.run.trial021.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T14:14:52.296 INFO:teuthology.orchestra.run.trial021.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T14:14:52.320 INFO:teuthology.orchestra.run.trial021.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T14:14:52.327 INFO:teuthology.orchestra.run.trial021.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T14:14:52.413 INFO:teuthology.orchestra.run.trial021.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T14:14:52.422 INFO:teuthology.orchestra.run.trial021.stderr:done 2026-02-25T14:14:52.424 DEBUG:teuthology.orchestra.run.trial021:> test -d /sys/firmware/efi 2026-02-25T14:14:52.440 DEBUG:teuthology.orchestra.run.trial021:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T14:14:52.505 INFO:teuthology.orchestra.run.trial021.stdout:/boot/efi/EFI/BOOT 2026-02-25T14:14:52.506 INFO:teuthology.orchestra.run.trial021.stdout:/boot/efi/EFI/centos 2026-02-25T14:14:52.508 DEBUG:teuthology.orchestra.run.trial021:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T14:14:52.573 INFO:teuthology.orchestra.run.trial021.stdout:no 2026-02-25T14:14:52.573 DEBUG:teuthology.orchestra.run.trial021:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T14:14:52.637 INFO:teuthology.orchestra.run.trial021.stdout:yes 2026-02-25T14:14:52.638 DEBUG:teuthology.orchestra.run.trial021:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T14:14:52.701 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial021 2026-02-25T14:14:52.702 DEBUG:teuthology.orchestra.run.trial021:> sudo bash -c ' 2026-02-25T14:14:52.702 DEBUG:teuthology.orchestra.run.trial021:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T14:14:52.702 DEBUG:teuthology.orchestra.run.trial021:> ' 2026-02-25T14:15:19.790 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-25T14:15:19.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-25T14:15:19.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:15:20.512 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-25T14:15:20.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-25T14:15:20.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:15:21.688 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-25T14:15:21.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-25T14:15:21.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:15:22.744 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-25T14:15:22.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial021.front.sepia.ceph.com' 2026-02-25T14:15:22.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:16:19.808 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:16:20.515 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:16:21.692 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:16:22.749 DEBUG:teuthology.orchestra.remote:timed out 2026-02-25T14:16:28.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-25T14:16:28.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:16:28.935 DEBUG:teuthology.orchestra.run.trial072:> true 2026-02-25T14:16:29.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-25T14:16:29.082 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:16:29.082 DEBUG:teuthology.orchestra.run.trial072:> uname -r 2026-02-25T14:16:29.137 INFO:teuthology.orchestra.run.trial072.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:16:29.137 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:16:29.137 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:16:29.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:16:29.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-25T14:16:29.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:16:29.634 DEBUG:teuthology.orchestra.run.trial068:> true 2026-02-25T14:16:29.794 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-25T14:16:29.795 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:16:29.795 DEBUG:teuthology.orchestra.run.trial068:> uname -r 2026-02-25T14:16:29.850 INFO:teuthology.orchestra.run.trial068.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:16:29.851 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:16:29.851 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:16:29.851 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:16:30.138 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-25T14:16:30.138 DEBUG:teuthology.orchestra.run.trial072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:16:30.168 INFO:teuthology.orchestra.run.trial072.stdout:ttyS1 2026-02-25T14:16:30.192 DEBUG:teuthology.parallel:result is None 2026-02-25T14:16:30.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-25T14:16:30.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:16:30.831 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-25T14:16:30.852 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-25T14:16:30.852 DEBUG:teuthology.orchestra.run.trial068:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:16:30.881 INFO:teuthology.orchestra.run.trial068.stdout:ttyS1 2026-02-25T14:16:30.905 DEBUG:teuthology.parallel:result is None 2026-02-25T14:16:30.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-25T14:16:30.988 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:16:30.988 DEBUG:teuthology.orchestra.run.trial031:> uname -r 2026-02-25T14:16:31.044 INFO:teuthology.orchestra.run.trial031.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:16:31.044 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:16:31.045 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:16:31.045 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:16:31.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial021.front.sepia.ceph.com' 2026-02-25T14:16:31.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:16:31.883 DEBUG:teuthology.orchestra.run.trial021:> true 2026-02-25T14:16:32.045 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-25T14:16:32.046 DEBUG:teuthology.orchestra.run.trial031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:16:32.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial021.front.sepia.ceph.com' 2026-02-25T14:16:32.050 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-25T14:16:32.050 DEBUG:teuthology.orchestra.run.trial021:> uname -r 2026-02-25T14:16:32.076 INFO:teuthology.orchestra.run.trial031.stdout:ttyS1 2026-02-25T14:16:32.103 DEBUG:teuthology.parallel:result is None 2026-02-25T14:16:32.106 INFO:teuthology.orchestra.run.trial021.stdout:5.14.0-686.el9.x86_64 2026-02-25T14:16:32.106 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T14:16:32.106 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T14:16:32.107 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T14:16:33.108 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-25T14:16:33.108 DEBUG:teuthology.orchestra.run.trial021:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T14:16:33.139 INFO:teuthology.orchestra.run.trial021.stdout:ttyS1 2026-02-25T14:16:33.169 DEBUG:teuthology.parallel:result is None 2026-02-25T14:16:33.169 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-25T14:16:33.184 INFO:teuthology.task.internal:Creating test directory... 2026-02-25T14:16:33.184 DEBUG:teuthology.orchestra.run.trial021:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:16:33.211 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:16:33.215 DEBUG:teuthology.orchestra.run.trial068:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:16:33.217 DEBUG:teuthology.orchestra.run.trial072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T14:16:33.235 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-25T14:16:33.247 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-25T14:16:33.261 INFO:teuthology.task.internal:Creating archive directory... 2026-02-25T14:16:33.261 DEBUG:teuthology.orchestra.run.trial021:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:16:33.267 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:16:33.271 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:16:33.275 DEBUG:teuthology.orchestra.run.trial072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T14:16:33.301 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-25T14:16:33.313 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-25T14:16:33.314 DEBUG:teuthology.orchestra.run.trial021:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:16:33.323 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:16:33.327 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:16:33.332 DEBUG:teuthology.orchestra.run.trial072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T14:16:33.344 INFO:teuthology.orchestra.run.trial021.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.349 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.354 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.354 INFO:teuthology.orchestra.run.trial021.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.356 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.357 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.362 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.366 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T14:16:33.367 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-25T14:16:33.379 INFO:teuthology.task.internal:Configuring sudo... 2026-02-25T14:16:33.380 DEBUG:teuthology.orchestra.run.trial021:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:16:33.397 DEBUG:teuthology.orchestra.run.trial031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:16:33.401 DEBUG:teuthology.orchestra.run.trial068:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:16:33.406 DEBUG:teuthology.orchestra.run.trial072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T14:16:33.431 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-25T14:16:33.447 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-25T14:16:33.447 DEBUG:teuthology.orchestra.run.trial021:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:16:33.462 DEBUG:teuthology.orchestra.run.trial031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:16:33.465 DEBUG:teuthology.orchestra.run.trial068:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:16:33.470 DEBUG:teuthology.orchestra.run.trial072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T14:16:33.487 DEBUG:teuthology.orchestra.run.trial021:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:33.633 DEBUG:teuthology.orchestra.run.trial021:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:33.658 DEBUG:teuthology.orchestra.run.trial021:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:33.806 DEBUG:teuthology.orchestra.run.trial021:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:33.829 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:16:33.830 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:16:33.894 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.011 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.037 DEBUG:teuthology.orchestra.run.trial031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.182 DEBUG:teuthology.orchestra.run.trial031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.207 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:16:34.207 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:16:34.278 DEBUG:teuthology.orchestra.run.trial068:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.394 DEBUG:teuthology.orchestra.run.trial068:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.419 DEBUG:teuthology.orchestra.run.trial068:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.585 DEBUG:teuthology.orchestra.run.trial068:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.609 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:16:34.609 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:16:34.673 DEBUG:teuthology.orchestra.run.trial072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.769 DEBUG:teuthology.orchestra.run.trial072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T14:16:34.796 DEBUG:teuthology.orchestra.run.trial072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.929 DEBUG:teuthology.orchestra.run.trial072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T14:16:34.952 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:16:34.952 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T14:16:35.016 DEBUG:teuthology.orchestra.run.trial021:> sudo service rsyslog restart 2026-02-25T14:16:35.018 DEBUG:teuthology.orchestra.run.trial031:> sudo service rsyslog restart 2026-02-25T14:16:35.021 DEBUG:teuthology.orchestra.run.trial068:> sudo service rsyslog restart 2026-02-25T14:16:35.024 DEBUG:teuthology.orchestra.run.trial072:> sudo service rsyslog restart 2026-02-25T14:16:35.045 INFO:teuthology.orchestra.run.trial021.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:16:35.047 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:16:35.050 INFO:teuthology.orchestra.run.trial068.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:16:35.083 INFO:teuthology.orchestra.run.trial072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T14:16:35.613 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-25T14:16:35.628 INFO:teuthology.task.internal:Starting timer... 2026-02-25T14:16:35.628 INFO:teuthology.run_tasks:Running task pcp... 2026-02-25T14:16:35.650 INFO:teuthology.run_tasks:Running task selinux... 2026-02-25T14:16:35.667 DEBUG:teuthology.orchestra.run.trial021:> sudo service auditd rotate 2026-02-25T14:16:35.697 INFO:teuthology.orchestra.run.trial021.stdout:Rotating logs: 2026-02-25T14:16:35.699 DEBUG:teuthology.orchestra.run.trial031:> sudo service auditd rotate 2026-02-25T14:16:35.729 INFO:teuthology.orchestra.run.trial031.stdout:Rotating logs: 2026-02-25T14:16:35.730 DEBUG:teuthology.orchestra.run.trial068:> sudo service auditd rotate 2026-02-25T14:16:35.760 INFO:teuthology.orchestra.run.trial068.stdout:Rotating logs: 2026-02-25T14:16:35.762 DEBUG:teuthology.orchestra.run.trial072:> sudo service auditd rotate 2026-02-25T14:16:35.792 INFO:teuthology.orchestra.run.trial072.stdout:Rotating logs: 2026-02-25T14:16:35.794 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-25T14:16:35.794 DEBUG:teuthology.orchestra.run.trial021:> /usr/sbin/getenforce 2026-02-25T14:16:35.812 INFO:teuthology.orchestra.run.trial021.stdout:Permissive 2026-02-25T14:16:35.812 DEBUG:teuthology.orchestra.run.trial031:> /usr/sbin/getenforce 2026-02-25T14:16:35.829 INFO:teuthology.orchestra.run.trial031.stdout:Permissive 2026-02-25T14:16:35.830 DEBUG:teuthology.orchestra.run.trial068:> /usr/sbin/getenforce 2026-02-25T14:16:35.848 INFO:teuthology.orchestra.run.trial068.stdout:Permissive 2026-02-25T14:16:35.848 DEBUG:teuthology.orchestra.run.trial072:> /usr/sbin/getenforce 2026-02-25T14:16:35.863 INFO:teuthology.orchestra.run.trial072.stdout:Permissive 2026-02-25T14:16:35.864 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial021.front.sepia.ceph.com': 'permissive', 'ubuntu@trial031.front.sepia.ceph.com': 'permissive', 'ubuntu@trial068.front.sepia.ceph.com': 'permissive', 'ubuntu@trial072.front.sepia.ceph.com': 'permissive'} 2026-02-25T14:16:35.864 DEBUG:teuthology.orchestra.run.trial021:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:16:35.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:16:35.887 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:16:35.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:16:35.912 DEBUG:teuthology.orchestra.run.trial068:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:16:35.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:16:35.938 DEBUG:teuthology.orchestra.run.trial072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T14:16:35.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T14:16:35.965 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-25T14:16:35.965 DEBUG:teuthology.orchestra.run.trial021:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:16:35.990 DEBUG:teuthology.orchestra.run.trial031:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:16:36.015 DEBUG:teuthology.orchestra.run.trial068:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:16:36.041 DEBUG:teuthology.orchestra.run.trial072:> sudo /usr/sbin/setenforce permissive 2026-02-25T14:16:36.067 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-25T14:16:36.082 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-25T14:16:36.085 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-25T14:16:36.232 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-25T14:16:36.242 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-25T14:16:36.243 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial021.front.sepia.ceph.com,trial031.front.sepia.ceph.com,trial068.front.sepia.ceph.com,trial072.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-25T14:19:30.447 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial021.front.sepia.ceph.com'), Remote(name='ubuntu@trial031.front.sepia.ceph.com'), Remote(name='ubuntu@trial068.front.sepia.ceph.com'), Remote(name='ubuntu@trial072.front.sepia.ceph.com')] 2026-02-25T14:19:30.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial021.front.sepia.ceph.com' 2026-02-25T14:19:30.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial021.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:30.540 DEBUG:teuthology.orchestra.run.trial021:> true 2026-02-25T14:19:30.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial021.front.sepia.ceph.com' 2026-02-25T14:19:30.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-25T14:19:30.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:30.708 DEBUG:teuthology.orchestra.run.trial031:> true 2026-02-25T14:19:30.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial031.front.sepia.ceph.com' 2026-02-25T14:19:30.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-25T14:19:30.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:30.878 DEBUG:teuthology.orchestra.run.trial068:> true 2026-02-25T14:19:30.953 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-25T14:19:30.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-25T14:19:30.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T14:19:31.024 DEBUG:teuthology.orchestra.run.trial072:> true 2026-02-25T14:19:31.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial072.front.sepia.ceph.com' 2026-02-25T14:19:31.103 INFO:teuthology.run_tasks:Running task clock... 2026-02-25T14:19:31.117 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-25T14:19:31.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:19:31.118 DEBUG:teuthology.orchestra.run.trial021:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:19:31.120 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:19:31.120 DEBUG:teuthology.orchestra.run.trial031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:19:31.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:19:31.122 DEBUG:teuthology.orchestra.run.trial068:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:19:31.124 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T14:19:31.124 DEBUG:teuthology.orchestra.run.trial072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T14:19:31.146 INFO:teuthology.orchestra.run.trial021.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:19:31.147 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:19:31.151 INFO:teuthology.orchestra.run.trial068.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:19:31.158 INFO:teuthology.orchestra.run.trial021.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:19:31.159 INFO:teuthology.orchestra.run.trial031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:19:31.163 INFO:teuthology.orchestra.run.trial068.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:19:31.168 INFO:teuthology.orchestra.run.trial072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T14:19:31.178 INFO:teuthology.orchestra.run.trial021.stderr:sudo: ntpd: command not found 2026-02-25T14:19:31.180 INFO:teuthology.orchestra.run.trial031.stderr:sudo: ntpd: command not found 2026-02-25T14:19:31.181 INFO:teuthology.orchestra.run.trial072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T14:19:31.185 INFO:teuthology.orchestra.run.trial068.stderr:sudo: ntpd: command not found 2026-02-25T14:19:31.188 INFO:teuthology.orchestra.run.trial021.stdout:506 Cannot talk to daemon 2026-02-25T14:19:31.190 INFO:teuthology.orchestra.run.trial031.stdout:506 Cannot talk to daemon 2026-02-25T14:19:31.195 INFO:teuthology.orchestra.run.trial068.stdout:506 Cannot talk to daemon 2026-02-25T14:19:31.200 INFO:teuthology.orchestra.run.trial021.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:19:31.200 INFO:teuthology.orchestra.run.trial072.stderr:sudo: ntpd: command not found 2026-02-25T14:19:31.201 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:19:31.207 INFO:teuthology.orchestra.run.trial068.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:19:31.209 INFO:teuthology.orchestra.run.trial072.stdout:506 Cannot talk to daemon 2026-02-25T14:19:31.211 INFO:teuthology.orchestra.run.trial021.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:19:31.213 INFO:teuthology.orchestra.run.trial031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:19:31.218 INFO:teuthology.orchestra.run.trial068.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:19:31.220 INFO:teuthology.orchestra.run.trial072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T14:19:31.232 INFO:teuthology.orchestra.run.trial072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T14:19:31.262 INFO:teuthology.orchestra.run.trial021.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:19:31.264 INFO:teuthology.orchestra.run.trial021.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:19:31.264 INFO:teuthology.orchestra.run.trial021.stdout:=============================================================================== 2026-02-25T14:19:31.269 INFO:teuthology.orchestra.run.trial068.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:19:31.271 INFO:teuthology.orchestra.run.trial068.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:19:31.271 INFO:teuthology.orchestra.run.trial068.stdout:=============================================================================== 2026-02-25T14:19:31.272 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:19:31.274 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:19:31.274 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-25T14:19:31.279 INFO:teuthology.orchestra.run.trial072.stderr:bash: line 1: ntpq: command not found 2026-02-25T14:19:31.280 INFO:teuthology.orchestra.run.trial072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T14:19:31.280 INFO:teuthology.orchestra.run.trial072.stdout:=============================================================================== 2026-02-25T14:19:31.282 INFO:teuthology.run_tasks:Running task install... 2026-02-25T14:19:31.302 DEBUG:teuthology.task.install:project ceph 2026-02-25T14:19:31.302 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919'}} 2026-02-25T14:19:31.303 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919'} 2026-02-25T14:19:31.303 INFO:teuthology.task.install:Using flavor: default 2026-02-25T14:19:31.320 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-25T14:19:31.320 INFO:teuthology.task.install:extra packages: [] 2026-02-25T14:19:31.321 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'tag': None, 'wait_for_package': False} 2026-02-25T14:19:31.323 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:19:31.326 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'tag': None, 'wait_for_package': False} 2026-02-25T14:19:31.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:19:31.327 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'tag': None, 'wait_for_package': False} 2026-02-25T14:19:31.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:19:31.329 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'tag': None, 'wait_for_package': False} 2026-02-25T14:19:31.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:19:31.584 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/ 2026-02-25T14:19:31.584 INFO:teuthology.task.install.rpm:Package version is 20.2.0-676.gc824a7fa 2026-02-25T14:19:31.613 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/ 2026-02-25T14:19:31.613 INFO:teuthology.task.install.rpm:Package version is 20.2.0-676.gc824a7fa 2026-02-25T14:19:31.613 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/ 2026-02-25T14:19:31.614 INFO:teuthology.task.install.rpm:Package version is 20.2.0-676.gc824a7fa 2026-02-25T14:19:31.614 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/ 2026-02-25T14:19:31.614 INFO:teuthology.task.install.rpm:Package version is 20.2.0-676.gc824a7fa 2026-02-25T14:19:31.848 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:19:31.848 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:19:31.848 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:19:31.857 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:19:31.857 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:19:31.857 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:19:31.865 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:19:31.865 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:19:31.865 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:19:31.867 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-ljs-perfissue/c824a7fa29b067db9ce5a381f59b175918299919/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T14:19:31.867 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:19:31.867 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T14:19:31.874 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:19:31.874 DEBUG:teuthology.orchestra.run.trial072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c824a7fa29b067db9ce5a381f59b175918299919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:19:31.882 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:19:31.882 DEBUG:teuthology.orchestra.run.trial031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c824a7fa29b067db9ce5a381f59b175918299919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:19:31.892 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:19:31.892 DEBUG:teuthology.orchestra.run.trial068:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c824a7fa29b067db9ce5a381f59b175918299919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:19:31.893 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-25T14:19:31.893 DEBUG:teuthology.orchestra.run.trial021:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c824a7fa29b067db9ce5a381f59b175918299919/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T14:19:31.939 DEBUG:teuthology.orchestra.run.trial072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:19:31.946 DEBUG:teuthology.orchestra.run.trial031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:19:31.957 DEBUG:teuthology.orchestra.run.trial068:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:19:31.958 DEBUG:teuthology.orchestra.run.trial021:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T14:19:32.011 DEBUG:teuthology.orchestra.run.trial072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:19:32.019 DEBUG:teuthology.orchestra.run.trial031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:19:32.030 DEBUG:teuthology.orchestra.run.trial021:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:19:32.031 DEBUG:teuthology.orchestra.run.trial068:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T14:19:32.075 INFO:teuthology.orchestra.run.trial072.stdout:check_obsoletes = 1 2026-02-25T14:19:32.076 DEBUG:teuthology.orchestra.run.trial072:> sudo yum clean all 2026-02-25T14:19:32.083 INFO:teuthology.orchestra.run.trial031.stdout:check_obsoletes = 1 2026-02-25T14:19:32.084 DEBUG:teuthology.orchestra.run.trial031:> sudo yum clean all 2026-02-25T14:19:32.094 INFO:teuthology.orchestra.run.trial021.stdout:check_obsoletes = 1 2026-02-25T14:19:32.094 INFO:teuthology.orchestra.run.trial068.stdout:check_obsoletes = 1 2026-02-25T14:19:32.095 DEBUG:teuthology.orchestra.run.trial021:> sudo yum clean all 2026-02-25T14:19:32.096 DEBUG:teuthology.orchestra.run.trial068:> sudo yum clean all 2026-02-25T14:19:32.224 INFO:teuthology.orchestra.run.trial072.stdout:41 files removed 2026-02-25T14:19:32.231 INFO:teuthology.orchestra.run.trial031.stdout:41 files removed 2026-02-25T14:19:32.238 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-radosgw 2026-02-25T14:19:32.242 INFO:teuthology.orchestra.run.trial021.stdout:41 files removed 2026-02-25T14:19:32.244 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-radosgw 2026-02-25T14:19:32.244 INFO:teuthology.orchestra.run.trial068.stdout:41 files removed 2026-02-25T14:19:32.256 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-radosgw 2026-02-25T14:19:32.257 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-radosgw 2026-02-25T14:19:32.538 INFO:teuthology.orchestra.run.trial068.stdout:ceph packages for x86_64 662 kB/s | 89 kB 00:00 2026-02-25T14:19:32.551 INFO:teuthology.orchestra.run.trial031.stdout:ceph packages for x86_64 556 kB/s | 89 kB 00:00 2026-02-25T14:19:32.556 INFO:teuthology.orchestra.run.trial021.stdout:ceph packages for x86_64 567 kB/s | 89 kB 00:00 2026-02-25T14:19:32.556 INFO:teuthology.orchestra.run.trial072.stdout:ceph packages for x86_64 534 kB/s | 89 kB 00:00 2026-02-25T14:19:32.702 INFO:teuthology.orchestra.run.trial021.stdout:ceph noarch packages 157 kB/s | 19 kB 00:00 2026-02-25T14:19:32.717 INFO:teuthology.orchestra.run.trial068.stdout:ceph noarch packages 123 kB/s | 19 kB 00:00 2026-02-25T14:19:32.731 INFO:teuthology.orchestra.run.trial031.stdout:ceph noarch packages 122 kB/s | 19 kB 00:00 2026-02-25T14:19:32.731 INFO:teuthology.orchestra.run.trial072.stdout:ceph noarch packages 129 kB/s | 19 kB 00:00 2026-02-25T14:19:32.855 INFO:teuthology.orchestra.run.trial021.stdout:ceph source packages 15 kB/s | 1.9 kB 00:00 2026-02-25T14:19:32.862 INFO:teuthology.orchestra.run.trial072.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-25T14:19:32.863 INFO:teuthology.orchestra.run.trial068.stdout:ceph source packages 16 kB/s | 1.9 kB 00:00 2026-02-25T14:19:32.872 INFO:teuthology.orchestra.run.trial031.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-25T14:19:33.756 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-25T14:19:34.092 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - BaseOS 7.4 MB/s | 8.9 MB 00:01 2026-02-25T14:19:35.033 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.9 MB 00:02 2026-02-25T14:19:36.498 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-25T14:19:36.670 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.9 MB 00:03 2026-02-25T14:19:37.273 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-25T14:19:38.974 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 27 MB 00:03 2026-02-25T14:19:39.459 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-25T14:19:40.283 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 8.0 MB 00:01 2026-02-25T14:19:40.673 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 8.0 MB 00:01 2026-02-25T14:19:41.175 INFO:teuthology.orchestra.run.trial072.stdout:CentOS Stream 9 - Extras packages 187 kB/s | 20 kB 00:00 2026-02-25T14:19:41.474 INFO:teuthology.orchestra.run.trial072.stdout:Extra Packages for Enterprise Linux 86 MB/s | 20 MB 00:00 2026-02-25T14:19:42.366 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 8.0 MB 00:00 2026-02-25T14:19:42.523 INFO:teuthology.orchestra.run.trial031.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-25T14:19:43.170 INFO:teuthology.orchestra.run.trial031.stdout:Extra Packages for Enterprise Linux 35 MB/s | 20 MB 00:00 2026-02-25T14:19:43.731 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 8.0 MB 00:01 2026-02-25T14:19:43.915 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-25T14:19:44.628 INFO:teuthology.orchestra.run.trial072.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T14:19:44.861 INFO:teuthology.orchestra.run.trial021.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 20 kB 00:00 2026-02-25T14:19:45.140 INFO:teuthology.orchestra.run.trial068.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-25T14:19:45.475 INFO:teuthology.orchestra.run.trial021.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-25T14:19:45.850 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout:Upgrading: 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout: librados2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.5 M 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout: librbd1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.8 M 2026-02-25T14:19:45.851 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.9 M 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: ceph-selinux x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 25 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 869 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libradosstriper1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 250 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: librgw2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.4 M 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-argparse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 45 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 175 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 163 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 324 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 305 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 99 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout:Installing weak dependencies: 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-daemon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 35 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-proxy2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 k 2026-02-25T14:19:45.852 INFO:teuthology.orchestra.run.trial072.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:Install 35 Packages 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:Upgrade 2 Packages 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 79 M 2026-02-25T14:19:45.853 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:19:46.369 INFO:teuthology.orchestra.run.trial031.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-25T14:19:46.630 INFO:teuthology.orchestra.run.trial072.stdout:(1/37): ceph-base-20.2.0-676.gc824a7fa.el9.x86_ 11 MB/s | 5.9 MB 00:00 2026-02-25T14:19:46.699 INFO:teuthology.orchestra.run.trial072.stdout:(2/37): ceph-selinux-20.2.0-676.gc824a7fa.el9.x 362 kB/s | 25 kB 00:00 2026-02-25T14:19:46.852 INFO:teuthology.orchestra.run.trial072.stdout:(3/37): libcephfs-daemon-20.2.0-676.gc824a7fa.e 231 kB/s | 35 kB 00:00 2026-02-25T14:19:46.974 INFO:teuthology.orchestra.run.trial072.stdout:(4/37): libcephfs-proxy2-20.2.0-676.gc824a7fa.e 200 kB/s | 24 kB 00:00 2026-02-25T14:19:47.096 INFO:teuthology.orchestra.run.trial072.stdout:(5/37): libcephfs2-20.2.0-676.gc824a7fa.el9.x86 7.0 MB/s | 869 kB 00:00 2026-02-25T14:19:47.132 INFO:teuthology.orchestra.run.trial072.stdout:(6/37): ceph-radosgw-20.2.0-676.gc824a7fa.el9.x 23 MB/s | 24 MB 00:01 2026-02-25T14:19:47.133 INFO:teuthology.orchestra.run.trial072.stdout:(7/37): libradosstriper1-20.2.0-676.gc824a7fa.e 6.5 MB/s | 250 kB 00:00 2026-02-25T14:19:47.153 INFO:teuthology.orchestra.run.trial072.stdout:(8/37): python3-ceph-argparse-20.2.0-676.gc824a 2.2 MB/s | 45 kB 00:00 2026-02-25T14:19:47.258 INFO:teuthology.orchestra.run.trial072.stdout:(9/37): python3-ceph-common-20.2.0-676.gc824a7f 1.6 MB/s | 175 kB 00:00 2026-02-25T14:19:47.301 INFO:teuthology.orchestra.run.trial072.stdout:(10/37): ceph-common-20.2.0-676.gc824a7fa.el9.x 20 MB/s | 24 MB 00:01 2026-02-25T14:19:47.304 INFO:teuthology.orchestra.run.trial072.stdout:(11/37): python3-cephfs-20.2.0-676.gc824a7fa.el 3.4 MB/s | 163 kB 00:00 2026-02-25T14:19:47.342 INFO:teuthology.orchestra.run.trial072.stdout:(12/37): librgw2-20.2.0-676.gc824a7fa.el9.x86_6 30 MB/s | 6.4 MB 00:00 2026-02-25T14:19:47.354 INFO:teuthology.orchestra.run.trial072.stdout:(13/37): python3-rados-20.2.0-676.gc824a7fa.el9 5.9 MB/s | 324 kB 00:00 2026-02-25T14:19:47.388 INFO:teuthology.orchestra.run.trial072.stdout:(14/37): python3-rbd-20.2.0-676.gc824a7fa.el9.x 3.6 MB/s | 305 kB 00:00 2026-02-25T14:19:47.399 INFO:teuthology.orchestra.run.trial072.stdout:(15/37): python3-rgw-20.2.0-676.gc824a7fa.el9.x 1.7 MB/s | 99 kB 00:00 2026-02-25T14:19:47.579 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout:Upgrading: 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: librados2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.5 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: librbd1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.8 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.9 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: ceph-selinux x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 25 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 869 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:19:47.581 INFO:teuthology.orchestra.run.trial031.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: libradosstriper1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 250 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: librgw2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.4 M 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-argparse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 45 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 175 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 163 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 324 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 305 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 99 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout:Installing weak dependencies: 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-daemon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 35 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-proxy2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout:Install 35 Packages 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout:Upgrade 2 Packages 2026-02-25T14:19:47.582 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:47.583 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 79 M 2026-02-25T14:19:47.583 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:19:47.631 INFO:teuthology.orchestra.run.trial072.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 120 kB/s | 33 kB 00:00 2026-02-25T14:19:47.737 INFO:teuthology.orchestra.run.trial072.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 988 kB/s | 104 kB 00:00 2026-02-25T14:19:47.781 INFO:teuthology.orchestra.run.trial072.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.6 MB/s | 164 kB 00:00 2026-02-25T14:19:47.793 INFO:teuthology.orchestra.run.trial072.stdout:(19/37): pciutils-3.7.0-7.el9.x86_64.rpm 236 kB/s | 93 kB 00:00 2026-02-25T14:19:47.805 INFO:teuthology.orchestra.run.trial072.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-25T14:19:47.851 INFO:teuthology.orchestra.run.trial072.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-25T14:19:47.878 INFO:teuthology.orchestra.run.trial072.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2026-02-25T14:19:47.988 INFO:teuthology.orchestra.run.trial072.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2026-02-25T14:19:48.017 INFO:teuthology.orchestra.run.trial072.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.2 MB/s | 37 kB 00:00 2026-02-25T14:19:48.039 INFO:teuthology.orchestra.run.trial072.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 1.4 MB/s | 240 kB 00:00 2026-02-25T14:19:48.058 INFO:teuthology.orchestra.run.trial072.stdout:(26/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-25T14:19:48.076 INFO:teuthology.orchestra.run.trial072.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.1 MB/s | 66 kB 00:00 2026-02-25T14:19:48.183 INFO:teuthology.orchestra.run.trial072.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 232 kB/s | 25 kB 00:00 2026-02-25T14:19:48.227 INFO:teuthology.orchestra.run.trial072.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-25T14:19:48.232 INFO:teuthology.orchestra.run.trial072.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-25T14:19:48.253 INFO:teuthology.orchestra.run.trial072.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2026-02-25T14:19:48.298 INFO:teuthology.orchestra.run.trial072.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-25T14:19:48.302 INFO:teuthology.orchestra.run.trial072.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2026-02-25T14:19:48.340 INFO:teuthology.orchestra.run.trial068.stdout:lab-extras 3.0 MB/s | 50 kB 00:00 2026-02-25T14:19:48.343 INFO:teuthology.orchestra.run.trial072.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2026-02-25T14:19:48.350 INFO:teuthology.orchestra.run.trial072.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-25T14:19:48.449 INFO:teuthology.orchestra.run.trial031.stdout:(1/37): ceph-base-20.2.0-676.gc824a7fa.el9.x86_ 17 MB/s | 5.9 MB 00:00 2026-02-25T14:19:48.484 INFO:teuthology.orchestra.run.trial031.stdout:(2/37): ceph-selinux-20.2.0-676.gc824a7fa.el9.x 706 kB/s | 25 kB 00:00 2026-02-25T14:19:48.517 INFO:teuthology.orchestra.run.trial031.stdout:(3/37): libcephfs-daemon-20.2.0-676.gc824a7fa.e 1.1 MB/s | 35 kB 00:00 2026-02-25T14:19:48.554 INFO:teuthology.orchestra.run.trial031.stdout:(4/37): libcephfs-proxy2-20.2.0-676.gc824a7fa.e 656 kB/s | 24 kB 00:00 2026-02-25T14:19:48.565 INFO:teuthology.orchestra.run.trial072.stdout:(36/37): librados2-20.2.0-676.gc824a7fa.el9.x86 13 MB/s | 3.5 MB 00:00 2026-02-25T14:19:48.590 INFO:teuthology.orchestra.run.trial031.stdout:(5/37): libcephfs2-20.2.0-676.gc824a7fa.el9.x86 24 MB/s | 869 kB 00:00 2026-02-25T14:19:48.613 INFO:teuthology.orchestra.run.trial031.stdout:(6/37): libradosstriper1-20.2.0-676.gc824a7fa.e 11 MB/s | 250 kB 00:00 2026-02-25T14:19:48.663 INFO:teuthology.orchestra.run.trial021.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-25T14:19:48.850 INFO:teuthology.orchestra.run.trial072.stdout:(37/37): librbd1-20.2.0-676.gc824a7fa.el9.x86_6 5.6 MB/s | 2.8 MB 00:00 2026-02-25T14:19:48.856 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:19:48.856 INFO:teuthology.orchestra.run.trial072.stdout:Total 26 MB/s | 79 MB 00:03 2026-02-25T14:19:48.886 INFO:teuthology.orchestra.run.trial031.stdout:(7/37): librgw2-20.2.0-676.gc824a7fa.el9.x86_64 23 MB/s | 6.4 MB 00:00 2026-02-25T14:19:48.913 INFO:teuthology.orchestra.run.trial031.stdout:(8/37): python3-ceph-argparse-20.2.0-676.gc824a 1.7 MB/s | 45 kB 00:00 2026-02-25T14:19:48.943 INFO:teuthology.orchestra.run.trial031.stdout:(9/37): python3-ceph-common-20.2.0-676.gc824a7f 5.7 MB/s | 175 kB 00:00 2026-02-25T14:19:48.951 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:19:48.970 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:19:48.970 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:19:48.972 INFO:teuthology.orchestra.run.trial031.stdout:(10/37): python3-cephfs-20.2.0-676.gc824a7fa.el 5.4 MB/s | 163 kB 00:00 2026-02-25T14:19:49.006 INFO:teuthology.orchestra.run.trial031.stdout:(11/37): python3-rados-20.2.0-676.gc824a7fa.el9 9.4 MB/s | 324 kB 00:00 2026-02-25T14:19:49.039 INFO:teuthology.orchestra.run.trial031.stdout:(12/37): python3-rbd-20.2.0-676.gc824a7fa.el9.x 9.0 MB/s | 305 kB 00:00 2026-02-25T14:19:49.069 INFO:teuthology.orchestra.run.trial031.stdout:(13/37): python3-rgw-20.2.0-676.gc824a7fa.el9.x 3.3 MB/s | 99 kB 00:00 2026-02-25T14:19:49.268 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:19:49.268 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:19:49.280 INFO:teuthology.orchestra.run.trial031.stdout:(14/37): ceph-common-20.2.0-676.gc824a7fa.el9.x 20 MB/s | 24 MB 00:01 2026-02-25T14:19:49.331 INFO:teuthology.orchestra.run.trial031.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 127 kB/s | 33 kB 00:00 2026-02-25T14:19:49.405 INFO:teuthology.orchestra.run.trial031.stdout:(16/37): ceph-radosgw-20.2.0-676.gc824a7fa.el9. 18 MB/s | 24 MB 00:01 2026-02-25T14:19:49.471 INFO:teuthology.orchestra.run.trial031.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-25T14:19:49.516 INFO:teuthology.orchestra.run.trial031.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.5 MB/s | 164 kB 00:00 2026-02-25T14:19:49.543 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:19:49.543 INFO:teuthology.orchestra.run.trial031.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.8 MB/s | 160 kB 00:00 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout:Upgrading: 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout: librados2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.5 M 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout: librbd1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.8 M 2026-02-25T14:19:49.545 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.9 M 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 25 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 869 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:19:49.546 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 250 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: librgw2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.4 M 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 45 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 175 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 163 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 324 k 2026-02-25T14:19:49.547 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 305 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 99 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout:Installing weak dependencies: 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-daemon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 35 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-proxy2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:19:49.548 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:19:49.549 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:19:49.549 INFO:teuthology.orchestra.run.trial068.stdout:Install 35 Packages 2026-02-25T14:19:49.549 INFO:teuthology.orchestra.run.trial068.stdout:Upgrade 2 Packages 2026-02-25T14:19:49.549 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:19:49.549 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 79 M 2026-02-25T14:19:49.550 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:19:49.559 INFO:teuthology.orchestra.run.trial031.stdout:(20/37): pciutils-3.7.0-7.el9.x86_64.rpm 409 kB/s | 93 kB 00:00 2026-02-25T14:19:49.566 INFO:teuthology.orchestra.run.trial031.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-25T14:19:49.592 INFO:teuthology.orchestra.run.trial031.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 11 MB/s | 292 kB 00:00 2026-02-25T14:19:49.612 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:19:49.615 INFO:teuthology.orchestra.run.trial031.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.8 MB/s | 240 kB 00:00 2026-02-25T14:19:49.623 INFO:teuthology.orchestra.run.trial072.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-25T14:19:49.638 INFO:teuthology.orchestra.run.trial031.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.6 MB/s | 37 kB 00:00 2026-02-25T14:19:49.662 INFO:teuthology.orchestra.run.trial031.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-02-25T14:19:49.684 INFO:teuthology.orchestra.run.trial031.stdout:(26/37): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2026-02-25T14:19:49.731 INFO:teuthology.orchestra.run.trial031.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 96 MB/s | 4.4 MB 00:00 2026-02-25T14:19:49.736 INFO:teuthology.orchestra.run.trial031.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 4.7 MB/s | 25 kB 00:00 2026-02-25T14:19:49.741 INFO:teuthology.orchestra.run.trial031.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 9.4 MB/s | 49 kB 00:00 2026-02-25T14:19:49.747 INFO:teuthology.orchestra.run.trial031.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 12 MB/s | 67 kB 00:00 2026-02-25T14:19:49.754 INFO:teuthology.orchestra.run.trial031.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 106 MB/s | 838 kB 00:00 2026-02-25T14:19:49.761 INFO:teuthology.orchestra.run.trial031.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 27 MB/s | 191 kB 00:00 2026-02-25T14:19:49.772 INFO:teuthology.orchestra.run.trial031.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 146 MB/s | 1.6 MB 00:00 2026-02-25T14:19:49.777 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-25T14:19:49.783 INFO:teuthology.orchestra.run.trial072.stdout: Upgrading : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:49.831 INFO:teuthology.orchestra.run.trial031.stdout:(34/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-25T14:19:49.831 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:49.832 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:49.845 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:49.847 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:49.848 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:49.858 INFO:teuthology.orchestra.run.trial031.stdout:(35/37): librados2-20.2.0-676.gc824a7fa.el9.x86 41 MB/s | 3.5 MB 00:00 2026-02-25T14:19:49.875 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:49.877 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:49.884 INFO:teuthology.orchestra.run.trial072.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-25T14:19:49.887 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-25T14:19:49.888 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repository Size 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout: ceph-radosgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout:Upgrading: 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout: librados2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.5 M 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout: librbd1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.8 M 2026-02-25T14:19:49.890 INFO:teuthology.orchestra.run.trial021.stdout:Installing dependencies: 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: ceph-base x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.9 M 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 M 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: ceph-selinux x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 25 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 869 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T14:19:49.891 INFO:teuthology.orchestra.run.trial021.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: libradosstriper1 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 250 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: librgw2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.4 M 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: python3-ceph-argparse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 45 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: python3-ceph-common x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 175 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: python3-cephfs x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 163 k 2026-02-25T14:19:49.892 INFO:teuthology.orchestra.run.trial021.stdout: python3-rados x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 324 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: python3-rbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 305 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: python3-rgw x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 99 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout:Installing weak dependencies: 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-daemon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 35 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-proxy2 x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 24 k 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-25T14:19:49.893 INFO:teuthology.orchestra.run.trial021.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout:Install 35 Packages 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout:Upgrade 2 Packages 2026-02-25T14:19:49.894 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:19:49.895 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-25T14:19:49.895 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-25T14:19:49.895 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 79 M 2026-02-25T14:19:49.895 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:19:49.902 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 12/39 2026-02-25T14:19:49.914 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:49.915 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:49.923 INFO:teuthology.orchestra.run.trial031.stdout:(36/37): librbd1-20.2.0-676.gc824a7fa.el9.x86_6 31 MB/s | 2.8 MB 00:00 2026-02-25T14:19:49.929 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:49.956 INFO:teuthology.orchestra.run.trial031.stdout:(37/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-25T14:19:49.958 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:19:49.958 INFO:teuthology.orchestra.run.trial031.stdout:Total 33 MB/s | 79 MB 00:02 2026-02-25T14:19:49.961 INFO:teuthology.orchestra.run.trial072.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-25T14:19:49.964 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-25T14:19:49.971 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-25T14:19:49.973 INFO:teuthology.orchestra.run.trial072.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-25T14:19:49.977 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-25T14:19:50.061 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:19:50.079 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:19:50.079 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:19:50.102 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:50.103 INFO:teuthology.orchestra.run.trial072.stdout: Upgrading : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:50.129 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:50.131 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 22/39 2026-02-25T14:19:50.139 INFO:teuthology.orchestra.run.trial072.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-25T14:19:50.378 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:19:50.378 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:19:50.417 INFO:teuthology.orchestra.run.trial072.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-25T14:19:50.418 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:50.435 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:50.439 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 26/39 2026-02-25T14:19:50.447 INFO:teuthology.orchestra.run.trial072.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-25T14:19:50.449 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-25T14:19:50.450 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:50.469 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:50.585 INFO:teuthology.orchestra.run.trial072.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-25T14:19:50.587 INFO:teuthology.orchestra.run.trial072.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:50.721 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:19:50.732 INFO:teuthology.orchestra.run.trial031.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-25T14:19:50.881 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:50.881 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T14:19:50.881 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:50.885 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-25T14:19:50.890 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:50.924 INFO:teuthology.orchestra.run.trial072.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-25T14:19:50.926 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 33/39 2026-02-25T14:19:50.940 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:50.941 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:50.955 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:50.957 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:50.958 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:50.985 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:50.988 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:50.995 INFO:teuthology.orchestra.run.trial031.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-25T14:19:50.998 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-25T14:19:51.001 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-25T14:19:51.005 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-25T14:19:51.014 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 12/39 2026-02-25T14:19:51.026 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:51.027 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:51.041 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:51.072 INFO:teuthology.orchestra.run.trial031.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-25T14:19:51.076 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-25T14:19:51.082 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-25T14:19:51.084 INFO:teuthology.orchestra.run.trial031.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-25T14:19:51.089 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-25T14:19:51.213 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:51.214 INFO:teuthology.orchestra.run.trial031.stdout: Upgrading : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:51.240 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:51.243 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 22/39 2026-02-25T14:19:51.251 INFO:teuthology.orchestra.run.trial031.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-25T14:19:51.470 INFO:teuthology.orchestra.run.trial068.stdout:(1/37): ceph-base-20.2.0-676.gc824a7fa.el9.x86_ 4.1 MB/s | 5.9 MB 00:01 2026-02-25T14:19:51.497 INFO:teuthology.orchestra.run.trial068.stdout:(2/37): ceph-selinux-20.2.0-676.gc824a7fa.el9.x 940 kB/s | 25 kB 00:00 2026-02-25T14:19:51.525 INFO:teuthology.orchestra.run.trial068.stdout:(3/37): libcephfs-daemon-20.2.0-676.gc824a7fa.e 1.2 MB/s | 35 kB 00:00 2026-02-25T14:19:51.529 INFO:teuthology.orchestra.run.trial031.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-25T14:19:51.531 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:51.547 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:51.552 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 26/39 2026-02-25T14:19:51.554 INFO:teuthology.orchestra.run.trial068.stdout:(4/37): libcephfs-proxy2-20.2.0-676.gc824a7fa.e 827 kB/s | 24 kB 00:00 2026-02-25T14:19:51.557 INFO:teuthology.orchestra.run.trial031.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-25T14:19:51.559 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-25T14:19:51.560 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:51.579 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:51.581 INFO:teuthology.orchestra.run.trial021.stdout:(1/37): ceph-base-20.2.0-676.gc824a7fa.el9.x86_ 4.0 MB/s | 5.9 MB 00:01 2026-02-25T14:19:51.613 INFO:teuthology.orchestra.run.trial021.stdout:(2/37): ceph-selinux-20.2.0-676.gc824a7fa.el9.x 790 kB/s | 25 kB 00:00 2026-02-25T14:19:51.641 INFO:teuthology.orchestra.run.trial068.stdout:(5/37): libcephfs2-20.2.0-676.gc824a7fa.el9.x86 9.8 MB/s | 869 kB 00:00 2026-02-25T14:19:51.646 INFO:teuthology.orchestra.run.trial021.stdout:(3/37): libcephfs-daemon-20.2.0-676.gc824a7fa.e 1.1 MB/s | 35 kB 00:00 2026-02-25T14:19:51.675 INFO:teuthology.orchestra.run.trial068.stdout:(6/37): libradosstriper1-20.2.0-676.gc824a7fa.e 7.3 MB/s | 250 kB 00:00 2026-02-25T14:19:51.678 INFO:teuthology.orchestra.run.trial021.stdout:(4/37): libcephfs-proxy2-20.2.0-676.gc824a7fa.e 744 kB/s | 24 kB 00:00 2026-02-25T14:19:51.695 INFO:teuthology.orchestra.run.trial031.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-25T14:19:51.697 INFO:teuthology.orchestra.run.trial031.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:51.822 INFO:teuthology.orchestra.run.trial021.stdout:(5/37): libcephfs2-20.2.0-676.gc824a7fa.el9.x86 5.9 MB/s | 869 kB 00:00 2026-02-25T14:19:51.872 INFO:teuthology.orchestra.run.trial021.stdout:(6/37): libradosstriper1-20.2.0-676.gc824a7fa.e 4.9 MB/s | 250 kB 00:00 2026-02-25T14:19:51.992 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:51.992 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T14:19:51.993 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:52.001 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:52.004 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:52.035 INFO:teuthology.orchestra.run.trial031.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-25T14:19:52.037 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 33/39 2026-02-25T14:19:52.302 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:52.305 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:52.344 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:52.345 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:19:52.345 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:19:52.345 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:52.348 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:52.402 INFO:teuthology.orchestra.run.trial068.stdout:(7/37): librgw2-20.2.0-676.gc824a7fa.el9.x86_64 8.8 MB/s | 6.4 MB 00:00 2026-02-25T14:19:52.448 INFO:teuthology.orchestra.run.trial068.stdout:(8/37): python3-ceph-argparse-20.2.0-676.gc824a 974 kB/s | 45 kB 00:00 2026-02-25T14:19:52.499 INFO:teuthology.orchestra.run.trial068.stdout:(9/37): python3-ceph-common-20.2.0-676.gc824a7f 3.4 MB/s | 175 kB 00:00 2026-02-25T14:19:52.549 INFO:teuthology.orchestra.run.trial068.stdout:(10/37): python3-cephfs-20.2.0-676.gc824a7fa.el 3.2 MB/s | 163 kB 00:00 2026-02-25T14:19:52.604 INFO:teuthology.orchestra.run.trial068.stdout:(11/37): python3-rados-20.2.0-676.gc824a7fa.el9 5.8 MB/s | 324 kB 00:00 2026-02-25T14:19:52.658 INFO:teuthology.orchestra.run.trial068.stdout:(12/37): python3-rbd-20.2.0-676.gc824a7fa.el9.x 5.5 MB/s | 305 kB 00:00 2026-02-25T14:19:52.709 INFO:teuthology.orchestra.run.trial068.stdout:(13/37): python3-rgw-20.2.0-676.gc824a7fa.el9.x 1.9 MB/s | 99 kB 00:00 2026-02-25T14:19:52.720 INFO:teuthology.orchestra.run.trial068.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 3.1 MB/s | 33 kB 00:00 2026-02-25T14:19:52.729 INFO:teuthology.orchestra.run.trial021.stdout:(7/37): librgw2-20.2.0-676.gc824a7fa.el9.x86_64 7.4 MB/s | 6.4 MB 00:00 2026-02-25T14:19:52.742 INFO:teuthology.orchestra.run.trial068.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 51 MB/s | 1.2 MB 00:00 2026-02-25T14:19:52.748 INFO:teuthology.orchestra.run.trial068.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 18 MB/s | 93 kB 00:00 2026-02-25T14:19:52.765 INFO:teuthology.orchestra.run.trial021.stdout:(8/37): python3-ceph-argparse-20.2.0-676.gc824a 1.2 MB/s | 45 kB 00:00 2026-02-25T14:19:52.790 INFO:teuthology.orchestra.run.trial068.stdout:(17/37): ceph-radosgw-20.2.0-676.gc824a7fa.el9. 8.6 MB/s | 24 MB 00:02 2026-02-25T14:19:52.800 INFO:teuthology.orchestra.run.trial021.stdout:(9/37): python3-ceph-common-20.2.0-676.gc824a7f 4.9 MB/s | 175 kB 00:00 2026-02-25T14:19:52.835 INFO:teuthology.orchestra.run.trial068.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-25T14:19:52.835 INFO:teuthology.orchestra.run.trial021.stdout:(10/37): python3-cephfs-20.2.0-676.gc824a7fa.el 4.5 MB/s | 163 kB 00:00 2026-02-25T14:19:52.836 INFO:teuthology.orchestra.run.trial068.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 1.2 MB/s | 104 kB 00:00 2026-02-25T14:19:52.869 INFO:teuthology.orchestra.run.trial068.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.6 MB/s | 160 kB 00:00 2026-02-25T14:19:52.870 INFO:teuthology.orchestra.run.trial068.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2026-02-25T14:19:52.874 INFO:teuthology.orchestra.run.trial021.stdout:(11/37): python3-rados-20.2.0-676.gc824a7fa.el9 8.2 MB/s | 324 kB 00:00 2026-02-25T14:19:52.913 INFO:teuthology.orchestra.run.trial021.stdout:(12/37): python3-rbd-20.2.0-676.gc824a7fa.el9.x 7.7 MB/s | 305 kB 00:00 2026-02-25T14:19:52.918 INFO:teuthology.orchestra.run.trial068.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2026-02-25T14:19:52.921 INFO:teuthology.orchestra.run.trial068.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 292 kB 00:00 2026-02-25T14:19:52.949 INFO:teuthology.orchestra.run.trial021.stdout:(13/37): python3-rgw-20.2.0-676.gc824a7fa.el9.x 2.7 MB/s | 99 kB 00:00 2026-02-25T14:19:52.949 INFO:teuthology.orchestra.run.trial068.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 7.8 MB/s | 240 kB 00:00 2026-02-25T14:19:52.968 INFO:teuthology.orchestra.run.trial068.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 804 kB/s | 37 kB 00:00 2026-02-25T14:19:52.977 INFO:teuthology.orchestra.run.trial068.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.3 MB/s | 66 kB 00:00 2026-02-25T14:19:53.016 INFO:teuthology.orchestra.run.trial021.stdout:(14/37): ceph-radosgw-20.2.0-676.gc824a7fa.el9. 8.1 MB/s | 24 MB 00:02 2026-02-25T14:19:53.110 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:53.113 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:53.210 INFO:teuthology.orchestra.run.trial021.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 127 kB/s | 33 kB 00:00 2026-02-25T14:19:53.272 INFO:teuthology.orchestra.run.trial068.stdout:(27/37): ceph-common-20.2.0-676.gc824a7fa.el9.x 7.3 MB/s | 24 MB 00:03 2026-02-25T14:19:53.409 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:53.413 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:53.437 INFO:teuthology.orchestra.run.trial021.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 410 kB/s | 93 kB 00:00 2026-02-25T14:19:53.452 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:53.452 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:19:53.452 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:19:53.452 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:53.455 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:53.568 INFO:teuthology.orchestra.run.trial068.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 84 kB/s | 25 kB 00:00 2026-02-25T14:19:53.643 INFO:teuthology.orchestra.run.trial021.stdout:(17/37): ceph-common-20.2.0-676.gc824a7fa.el9.x 6.7 MB/s | 24 MB 00:03 2026-02-25T14:19:53.648 INFO:teuthology.orchestra.run.trial068.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 452 kB/s | 308 kB 00:00 2026-02-25T14:19:53.689 INFO:teuthology.orchestra.run.trial068.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 404 kB/s | 49 kB 00:00 2026-02-25T14:19:53.695 INFO:teuthology.orchestra.run.trial021.stdout:(18/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-25T14:19:53.735 INFO:teuthology.orchestra.run.trial021.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 349 kB/s | 104 kB 00:00 2026-02-25T14:19:53.768 INFO:teuthology.orchestra.run.trial068.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 563 kB/s | 67 kB 00:00 2026-02-25T14:19:53.964 INFO:teuthology.orchestra.run.trial021.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 510 kB/s | 164 kB 00:00 2026-02-25T14:19:53.972 INFO:teuthology.orchestra.run.trial021.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 190 kB/s | 45 kB 00:00 2026-02-25T14:19:54.170 INFO:teuthology.orchestra.run.trial068.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 477 kB/s | 191 kB 00:00 2026-02-25T14:19:54.287 INFO:teuthology.orchestra.run.trial021.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 271 kB/s | 160 kB 00:00 2026-02-25T14:19:54.386 INFO:teuthology.orchestra.run.trial021.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 708 kB/s | 292 kB 00:00 2026-02-25T14:19:54.573 INFO:teuthology.orchestra.run.trial021.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 198 kB/s | 37 kB 00:00 2026-02-25T14:19:54.663 INFO:teuthology.orchestra.run.trial021.stdout:(25/37): librdkafka-1.6.1-102.el9.x86_64.rpm 949 kB/s | 662 kB 00:00 2026-02-25T14:19:54.666 INFO:teuthology.orchestra.run.trial021.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 632 kB/s | 240 kB 00:00 2026-02-25T14:19:54.732 INFO:teuthology.orchestra.run.trial068.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 803 kB/s | 838 kB 00:01 2026-02-25T14:19:54.792 INFO:teuthology.orchestra.run.trial021.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.3 MB/s | 308 kB 00:00 2026-02-25T14:19:54.802 INFO:teuthology.orchestra.run.trial021.stdout:(28/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 290 kB/s | 66 kB 00:00 2026-02-25T14:19:54.813 INFO:teuthology.orchestra.run.trial021.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-25T14:19:54.834 INFO:teuthology.orchestra.run.trial021.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-25T14:19:54.870 INFO:teuthology.orchestra.run.trial068.stdout:(34/37): librados2-20.2.0-676.gc824a7fa.el9.x86 26 MB/s | 3.5 MB 00:00 2026-02-25T14:19:54.872 INFO:teuthology.orchestra.run.trial021.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2026-02-25T14:19:54.876 INFO:teuthology.orchestra.run.trial021.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-25T14:19:54.880 INFO:teuthology.orchestra.run.trial021.stdout:(33/37): liboath-2.6.12-1.el9.x86_64.rpm 628 kB/s | 49 kB 00:00 2026-02-25T14:19:54.895 INFO:teuthology.orchestra.run.trial021.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 8.2 MB/s | 191 kB 00:00 2026-02-25T14:19:54.940 INFO:teuthology.orchestra.run.trial068.stdout:(35/37): librbd1-20.2.0-676.gc824a7fa.el9.x86_6 40 MB/s | 2.8 MB 00:00 2026-02-25T14:19:54.946 INFO:teuthology.orchestra.run.trial021.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 23 MB/s | 1.6 MB 00:00 2026-02-25T14:19:55.127 INFO:teuthology.orchestra.run.trial021.stdout:(36/37): librados2-20.2.0-676.gc824a7fa.el9.x86 14 MB/s | 3.5 MB 00:00 2026-02-25T14:19:55.152 INFO:teuthology.orchestra.run.trial021.stdout:(37/37): librbd1-20.2.0-676.gc824a7fa.el9.x86_6 11 MB/s | 2.8 MB 00:00 2026-02-25T14:19:55.154 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:19:55.154 INFO:teuthology.orchestra.run.trial021.stdout:Total 15 MB/s | 79 MB 00:05 2026-02-25T14:19:55.253 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:19:55.272 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:19:55.272 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:19:55.297 INFO:teuthology.orchestra.run.trial068.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 1.4 MB/s | 1.6 MB 00:01 2026-02-25T14:19:55.571 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:19:55.571 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:19:55.916 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:19:55.927 INFO:teuthology.orchestra.run.trial021.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-25T14:19:56.006 INFO:teuthology.orchestra.run.trial068.stdout:(37/37): libarrow-9.0.0-15.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:03 2026-02-25T14:19:56.011 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:19:56.011 INFO:teuthology.orchestra.run.trial068.stdout:Total 12 MB/s | 79 MB 00:06 2026-02-25T14:19:56.081 INFO:teuthology.orchestra.run.trial021.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-25T14:19:56.086 INFO:teuthology.orchestra.run.trial021.stdout: Upgrading : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:56.111 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:19:56.130 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:19:56.130 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:19:56.134 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:56.136 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:56.149 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:56.152 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:56.152 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:56.179 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:56.181 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:56.188 INFO:teuthology.orchestra.run.trial021.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-25T14:19:56.191 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-25T14:19:56.194 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-25T14:19:56.198 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-25T14:19:56.206 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 12/39 2026-02-25T14:19:56.218 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:56.219 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:56.231 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:56.261 INFO:teuthology.orchestra.run.trial021.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-25T14:19:56.265 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-25T14:19:56.271 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-25T14:19:56.273 INFO:teuthology.orchestra.run.trial021.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-25T14:19:56.277 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-25T14:19:56.401 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:56.402 INFO:teuthology.orchestra.run.trial021.stdout: Upgrading : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:56.426 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:19:56.426 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:19:56.427 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:56.430 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 22/39 2026-02-25T14:19:56.438 INFO:teuthology.orchestra.run.trial021.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-25T14:19:56.720 INFO:teuthology.orchestra.run.trial021.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-25T14:19:56.721 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:56.738 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:56.742 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 26/39 2026-02-25T14:19:56.746 INFO:teuthology.orchestra.run.trial021.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-25T14:19:56.749 INFO:teuthology.orchestra.run.trial021.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-25T14:19:56.750 INFO:teuthology.orchestra.run.trial021.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:56.769 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:56.769 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:19:56.782 INFO:teuthology.orchestra.run.trial068.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-25T14:19:56.883 INFO:teuthology.orchestra.run.trial021.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-25T14:19:56.885 INFO:teuthology.orchestra.run.trial021.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:56.910 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:56.910 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /sys 2026-02-25T14:19:56.910 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /proc 2026-02-25T14:19:56.910 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /mnt 2026-02-25T14:19:56.911 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /var/tmp 2026-02-25T14:19:56.911 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /home 2026-02-25T14:19:56.911 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /root 2026-02-25T14:19:56.911 INFO:teuthology.orchestra.run.trial072.stdout:skipping the directory /tmp 2026-02-25T14:19:56.911 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:56.936 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-25T14:19:56.939 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:56.987 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:56.988 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:57.000 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:57.002 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:57.003 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:57.031 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:57.033 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:57.040 INFO:teuthology.orchestra.run.trial068.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-25T14:19:57.043 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-25T14:19:57.046 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-25T14:19:57.050 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-25T14:19:57.059 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 12/39 2026-02-25T14:19:57.070 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:57.071 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:57.085 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:57.120 INFO:teuthology.orchestra.run.trial068.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-25T14:19:57.124 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-25T14:19:57.130 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-25T14:19:57.132 INFO:teuthology.orchestra.run.trial068.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-25T14:19:57.137 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-25T14:19:57.167 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:57.167 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T14:19:57.167 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:19:57.208 INFO:teuthology.orchestra.run.trial021.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-25T14:19:57.210 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 33/39 2026-02-25T14:19:57.260 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:57.261 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:57.286 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 21/39 2026-02-25T14:19:57.290 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 22/39 2026-02-25T14:19:57.297 INFO:teuthology.orchestra.run.trial068.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-25T14:19:57.575 INFO:teuthology.orchestra.run.trial068.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-25T14:19:57.576 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:57.592 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 25/39 2026-02-25T14:19:57.597 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 26/39 2026-02-25T14:19:57.601 INFO:teuthology.orchestra.run.trial068.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-25T14:19:57.604 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-25T14:19:57.604 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:57.622 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-25T14:19:57.737 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-25T14:19:57.739 INFO:teuthology.orchestra.run.trial068.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /sys 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /proc 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /mnt 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /var/tmp 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /home 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /root 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout:skipping the directory /tmp 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:57.940 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:19:57.964 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:57.966 INFO:teuthology.orchestra.run.trial072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:19:57.978 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:19:57.978 INFO:teuthology.orchestra.run.trial072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:58.016 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-25T14:19:58.016 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-25T14:19:58.016 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:19:58.036 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:58.036 INFO:teuthology.orchestra.run.trial072.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:19:58.036 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:58.059 INFO:teuthology.orchestra.run.trial068.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-25T14:19:58.061 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 33/39 2026-02-25T14:19:58.282 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:58.284 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:58.355 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 1/39 2026-02-25T14:19:58.355 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 8/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 9/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 10/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 11/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 12/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:58.356 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 15/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-25T14:19:58.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-25T14:19:58.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 38/39 2026-02-25T14:19:58.421 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout:Upgraded: 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.422 INFO:teuthology.orchestra.run.trial072.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:58.423 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:19:58.466 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-test 2026-02-25T14:19:58.578 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:58.581 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:58.623 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:58.623 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:19:58.623 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:19:58.623 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:19:58.626 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:58.780 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:14 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:19:58.864 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:19:58.865 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:58.865 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-25T14:19:58.865 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:58.865 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 84 M 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: libcephsqlite x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 164 k 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:19:58.866 INFO:teuthology.orchestra.run.trial072.stdout:Install 5 Packages 2026-02-25T14:19:58.867 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:19:58.867 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 85 M 2026-02-25T14:19:58.867 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 365 M 2026-02-25T14:19:58.867 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:19:58.969 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:19:58.993 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:19:58.993 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:19:58.993 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:19:58.993 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:19:58.993 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:19:58.994 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:58.995 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:19:59.008 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:19:59.008 INFO:teuthology.orchestra.run.trial031.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:59.034 INFO:teuthology.orchestra.run.trial072.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 2.1 MB/s | 233 kB 00:00 2026-02-25T14:19:59.065 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:59.065 INFO:teuthology.orchestra.run.trial031.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:19:59.065 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:59.078 INFO:teuthology.orchestra.run.trial072.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 6.8 MB/s | 303 kB 00:00 2026-02-25T14:19:59.098 INFO:teuthology.orchestra.run.trial072.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.1 MB/s | 64 kB 00:00 2026-02-25T14:19:59.129 INFO:teuthology.orchestra.run.trial072.stdout:(4/5): libcephsqlite-20.2.0-676.gc824a7fa.el9.x 801 kB/s | 164 kB 00:00 2026-02-25T14:19:59.135 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:59.137 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:59.386 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 1/39 2026-02-25T14:19:59.386 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2/39 2026-02-25T14:19:59.386 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:19:59.386 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 8/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 9/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 10/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 11/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 12/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 15/39 2026-02-25T14:19:59.387 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-25T14:19:59.388 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-25T14:19:59.389 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 38/39 2026-02-25T14:19:59.430 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 34/39 2026-02-25T14:19:59.434 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout:Upgraded: 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.456 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.457 INFO:teuthology.orchestra.run.trial031.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:19:59.458 INFO:teuthology.orchestra.run.trial031.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:19:59.459 INFO:teuthology.orchestra.run.trial031.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:19:59.460 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:59.460 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:19:59.474 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 35/39 2026-02-25T14:19:59.475 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T14:19:59.475 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T14:19:59.475 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:19:59.478 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:19:59.499 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-test 2026-02-25T14:19:59.813 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:13 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:19:59.896 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:19:59.897 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 84 M 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: libcephsqlite x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 164 k 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:59.898 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout:Install 5 Packages 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 85 M 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 365 M 2026-02-25T14:19:59.899 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:00.243 INFO:teuthology.orchestra.run.trial031.stdout:(1/5): libcephsqlite-20.2.0-676.gc824a7fa.el9.x 1.7 MB/s | 164 kB 00:00 2026-02-25T14:20:00.898 INFO:teuthology.orchestra.run.trial031.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 311 kB/s | 233 kB 00:00 2026-02-25T14:20:01.046 INFO:teuthology.orchestra.run.trial031.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 378 kB/s | 303 kB 00:00 2026-02-25T14:20:01.063 INFO:teuthology.orchestra.run.trial031.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 384 kB/s | 64 kB 00:00 2026-02-25T14:20:03.140 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /sys 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /proc 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /mnt 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /var/tmp 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /home 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /root 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout:skipping the directory /tmp 2026-02-25T14:20:03.141 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:03.638 INFO:teuthology.orchestra.run.trial031.stdout:(5/5): ceph-test-20.2.0-676.gc824a7fa.el9.x86_6 24 MB/s | 84 MB 00:03 2026-02-25T14:20:03.640 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:03.640 INFO:teuthology.orchestra.run.trial031.stdout:Total 23 MB/s | 85 MB 00:03 2026-02-25T14:20:03.666 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:03.677 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:03.677 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:03.790 INFO:teuthology.orchestra.run.trial072.stdout:(5/5): ceph-test-20.2.0-676.gc824a7fa.el9.x86_6 17 MB/s | 84 MB 00:04 2026-02-25T14:20:03.791 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:03.791 INFO:teuthology.orchestra.run.trial072.stdout:Total 17 MB/s | 85 MB 00:04 2026-02-25T14:20:03.818 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:03.829 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:03.829 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:03.966 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:03.966 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:04.051 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:20:04.051 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /sys 2026-02-25T14:20:04.051 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /proc 2026-02-25T14:20:04.051 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /mnt 2026-02-25T14:20:04.051 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /var/tmp 2026-02-25T14:20:04.052 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /home 2026-02-25T14:20:04.052 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /root 2026-02-25T14:20:04.052 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /tmp 2026-02-25T14:20:04.052 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:04.116 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:04.116 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:04.168 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:20:04.191 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:20:04.191 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:04.191 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:20:04.191 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:20:04.191 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:20:04.192 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:04.193 INFO:teuthology.orchestra.run.trial021.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:20:04.204 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:20:04.205 INFO:teuthology.orchestra.run.trial021.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:04.261 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:04.261 INFO:teuthology.orchestra.run.trial021.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:20:04.261 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:04.281 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:04.287 INFO:teuthology.orchestra.run.trial031.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:20:04.291 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:20:04.299 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:20:04.300 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:04.429 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:04.434 INFO:teuthology.orchestra.run.trial072.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:20:04.439 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:20:04.447 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:20:04.448 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 1/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 8/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 9/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 10/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 11/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 12/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 15/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-25T14:20:04.591 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-25T14:20:04.592 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 38/39 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout:Upgraded: 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:20:04.660 INFO:teuthology.orchestra.run.trial021.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:04.661 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:04.704 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-test 2026-02-25T14:20:05.022 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:17 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:05.078 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:20:05.100 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 37/39 2026-02-25T14:20:05.101 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:05.101 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T14:20:05.101 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:20:05.101 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T14:20:05.101 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:05.103 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:20:05.105 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repository Size 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: ceph-test x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 84 M 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:Installing dependencies: 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: libcephsqlite x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 164 k 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:05.106 INFO:teuthology.orchestra.run.trial021.stdout:Install 5 Packages 2026-02-25T14:20:05.107 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:05.107 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 85 M 2026-02-25T14:20:05.107 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 365 M 2026-02-25T14:20:05.107 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:05.114 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-25T14:20:05.114 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:05.172 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:05.172 INFO:teuthology.orchestra.run.trial068.stdout:Creating group 'qat' with GID 992. 2026-02-25T14:20:05.172 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:05.218 INFO:teuthology.orchestra.run.trial021.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 7.7 MB/s | 233 kB 00:00 2026-02-25T14:20:05.234 INFO:teuthology.orchestra.run.trial021.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 20 MB/s | 303 kB 00:00 2026-02-25T14:20:05.240 INFO:teuthology.orchestra.run.trial021.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 11 MB/s | 64 kB 00:00 2026-02-25T14:20:05.386 INFO:teuthology.orchestra.run.trial021.stdout:(4/5): libcephsqlite-20.2.0-676.gc824a7fa.el9.x 834 kB/s | 164 kB 00:00 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 1/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 3/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 4/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 5/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 6/39 2026-02-25T14:20:05.498 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 7/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 8/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 9/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x 10/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86 11/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 12/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 13/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 14/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 15/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-25T14:20:05.499 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-25T14:20:05.500 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 36/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-25T14:20:05.501 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 38/39 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout:Upgraded: 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-25T14:20:05.566 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-daemon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-proxy2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T14:20:05.567 INFO:teuthology.orchestra.run.trial068.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: librgw2-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.568 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: re2-1:20211101-20.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:05.569 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:05.611 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-test 2026-02-25T14:20:05.921 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:17 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:06.005 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 84 M 2026-02-25T14:20:06.006 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: libcephsqlite x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 164 k 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout:Install 5 Packages 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 85 M 2026-02-25T14:20:06.007 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 365 M 2026-02-25T14:20:06.008 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:06.643 INFO:teuthology.orchestra.run.trial068.stdout:(1/5): libcephsqlite-20.2.0-676.gc824a7fa.el9.x 494 kB/s | 164 kB 00:00 2026-02-25T14:20:06.790 INFO:teuthology.orchestra.run.trial068.stdout:[MIRROR] libxslt-1.1.34-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libxslt-1.1.34-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:07.042 INFO:teuthology.orchestra.run.trial068.stdout:[MIRROR] socat-1.7.4.1-8.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/socat-1.7.4.1-8.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:07.428 INFO:teuthology.orchestra.run.trial068.stdout:[MIRROR] libxslt-1.1.34-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/libxslt-1.1.34-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:07.477 INFO:teuthology.orchestra.run.trial068.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 200 kB/s | 233 kB 00:01 2026-02-25T14:20:08.036 INFO:teuthology.orchestra.run.trial068.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 114 kB/s | 64 kB 00:00 2026-02-25T14:20:08.095 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:08.113 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:08.151 INFO:teuthology.orchestra.run.trial068.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 201 kB/s | 303 kB 00:01 2026-02-25T14:20:08.158 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:08.177 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:08.482 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:08.482 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 1/5 2026-02-25T14:20:08.482 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2/5 2026-02-25T14:20:08.482 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:20:08.482 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:20:08.531 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:08.531 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 1/5 2026-02-25T14:20:08.531 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2/5 2026-02-25T14:20:08.531 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:20:08.531 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:20:08.541 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:20:08.541 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:08.541 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:08.541 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:08.542 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:08.577 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph 2026-02-25T14:20:08.591 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:20:08.591 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:08.591 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:08.592 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:08.627 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph 2026-02-25T14:20:08.679 INFO:teuthology.orchestra.run.trial068.stdout:(5/5): ceph-test-20.2.0-676.gc824a7fa.el9.x86_6 35 MB/s | 84 MB 00:02 2026-02-25T14:20:08.683 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:08.683 INFO:teuthology.orchestra.run.trial068.stdout:Total 32 MB/s | 85 MB 00:02 2026-02-25T14:20:08.709 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:08.719 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:08.719 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:08.887 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:22 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:08.941 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:24 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:08.974 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:08.977 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-25T14:20:08.977 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repository Size 2026-02-25T14:20:08.977 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.5 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout:Installing dependencies: 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-grafana-dashboards noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 43 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.3 M 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 961 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-modules-core noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 290 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.0 M 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 17 M 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: ceph-prometheus-alerts noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 17 k 2026-02-25T14:20:08.978 INFO:teuthology.orchestra.run.trial031.stdout: cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 1.0 M 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:20:08.979 INFO:teuthology.orchestra.run.trial031.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:20:08.980 INFO:teuthology.orchestra.run.trial031.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:20:08.981 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:20:08.982 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:20:08.983 INFO:teuthology.orchestra.run.trial031.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T14:20:08.984 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout:Installing weak dependencies: 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 173 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-dashboard noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 11 M 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 7.4 M 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 22 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-rook noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 50 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: ceph-volume noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 297 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T14:20:08.985 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:08.986 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:08.986 INFO:teuthology.orchestra.run.trial031.stdout:====================================================================================== 2026-02-25T14:20:08.986 INFO:teuthology.orchestra.run.trial031.stdout:Install 95 Packages 2026-02-25T14:20:08.986 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:08.987 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 101 M 2026-02-25T14:20:08.987 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 561 M 2026-02-25T14:20:08.987 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:09.009 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:09.009 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:09.028 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repository Size 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.5 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout:Installing dependencies: 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-grafana-dashboards noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 43 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.3 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 961 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-modules-core noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 290 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.0 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 17 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ceph-prometheus-alerts noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 17 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 1.0 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:20:09.031 INFO:teuthology.orchestra.run.trial072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:20:09.032 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout:Installing weak dependencies: 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 173 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-dashboard noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 11 M 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 7.4 M 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 22 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-rook noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 50 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: ceph-volume noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 297 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:09.033 INFO:teuthology.orchestra.run.trial072.stdout:====================================================================================== 2026-02-25T14:20:09.034 INFO:teuthology.orchestra.run.trial072.stdout:Install 95 Packages 2026-02-25T14:20:09.034 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:09.034 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 101 M 2026-02-25T14:20:09.034 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 561 M 2026-02-25T14:20:09.034 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:09.324 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:09.330 INFO:teuthology.orchestra.run.trial068.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:20:09.334 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:20:09.342 INFO:teuthology.orchestra.run.trial068.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:20:09.343 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:09.862 INFO:teuthology.orchestra.run.trial031.stdout:(1/95): ceph-20.2.0-676.gc824a7fa.el9.x86_64.rp 18 kB/s | 6.5 kB 00:00 2026-02-25T14:20:09.862 INFO:teuthology.orchestra.run.trial072.stdout:(1/95): ceph-20.2.0-676.gc824a7fa.el9.x86_64.rp 19 kB/s | 6.5 kB 00:00 2026-02-25T14:20:09.990 INFO:teuthology.orchestra.run.trial031.stdout:(2/95): ceph-mds-20.2.0-676.gc824a7fa.el9.x86_6 4.9 MB/s | 2.3 MB 00:00 2026-02-25T14:20:10.028 INFO:teuthology.orchestra.run.trial031.stdout:(3/95): ceph-mgr-20.2.0-676.gc824a7fa.el9.x86_6 1.8 MB/s | 961 kB 00:00 2026-02-25T14:20:10.203 INFO:teuthology.orchestra.run.trial031.stdout:(4/95): ceph-grafana-dashboards-20.2.0-676.gc82 247 kB/s | 43 kB 00:00 2026-02-25T14:20:10.295 INFO:teuthology.orchestra.run.trial031.stdout:(5/95): ceph-mgr-cephadm-20.2.0-676.gc824a7fa.e 1.8 MB/s | 173 kB 00:00 2026-02-25T14:20:10.670 INFO:teuthology.orchestra.run.trial072.stdout:(2/95): ceph-mgr-20.2.0-676.gc824a7fa.el9.x86_6 831 kB/s | 961 kB 00:01 2026-02-25T14:20:11.108 INFO:teuthology.orchestra.run.trial072.stdout:(3/95): ceph-mds-20.2.0-676.gc824a7fa.el9.x86_6 1.5 MB/s | 2.3 MB 00:01 2026-02-25T14:20:11.376 INFO:teuthology.orchestra.run.trial072.stdout:(4/95): ceph-grafana-dashboards-20.2.0-676.gc82 161 kB/s | 43 kB 00:00 2026-02-25T14:20:11.505 INFO:teuthology.orchestra.run.trial072.stdout:(5/95): ceph-mgr-cephadm-20.2.0-676.gc824a7fa.e 1.3 MB/s | 173 kB 00:00 2026-02-25T14:20:11.514 INFO:teuthology.orchestra.run.trial031.stdout:(6/95): ceph-osd-20.2.0-676.gc824a7fa.el9.x86_6 11 MB/s | 17 MB 00:01 2026-02-25T14:20:11.681 INFO:teuthology.orchestra.run.trial072.stdout:(6/95): ceph-mon-20.2.0-676.gc824a7fa.el9.x86_6 2.8 MB/s | 5.0 MB 00:01 2026-02-25T14:20:11.681 INFO:teuthology.orchestra.run.trial031.stdout:(7/95): ceph-mon-20.2.0-676.gc824a7fa.el9.x86_6 2.8 MB/s | 5.0 MB 00:01 2026-02-25T14:20:12.197 INFO:teuthology.orchestra.run.trial031.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-676.gc824a7fa 43 kB/s | 22 kB 00:00 2026-02-25T14:20:12.360 INFO:teuthology.orchestra.run.trial031.stdout:(9/95): ceph-mgr-diskprediction-local-20.2.0-67 8.8 MB/s | 7.4 MB 00:00 2026-02-25T14:20:12.402 INFO:teuthology.orchestra.run.trial031.stdout:(10/95): ceph-mgr-modules-core-20.2.0-676.gc824 1.4 MB/s | 290 kB 00:00 2026-02-25T14:20:12.417 INFO:teuthology.orchestra.run.trial031.stdout:(11/95): ceph-mgr-rook-20.2.0-676.gc824a7fa.el9 876 kB/s | 50 kB 00:00 2026-02-25T14:20:12.457 INFO:teuthology.orchestra.run.trial031.stdout:(12/95): ceph-prometheus-alerts-20.2.0-676.gc82 319 kB/s | 17 kB 00:00 2026-02-25T14:20:12.548 INFO:teuthology.orchestra.run.trial031.stdout:(13/95): ceph-volume-20.2.0-676.gc824a7fa.el9.n 2.2 MB/s | 297 kB 00:00 2026-02-25T14:20:12.922 INFO:teuthology.orchestra.run.trial031.stdout:(14/95): cephadm-20.2.0-676.gc824a7fa.el9.noarc 2.1 MB/s | 1.0 MB 00:00 2026-02-25T14:20:13.069 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:13.088 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:13.396 INFO:teuthology.orchestra.run.trial031.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 85 kB/s | 40 kB 00:00 2026-02-25T14:20:13.417 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:13.417 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 1/5 2026-02-25T14:20:13.417 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2/5 2026-02-25T14:20:13.417 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:20:13.417 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:13.478 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:13.515 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph 2026-02-25T14:20:13.687 INFO:teuthology.orchestra.run.trial031.stdout:(16/95): ceph-mgr-dashboard-20.2.0-676.gc824a7f 3.1 MB/s | 11 MB 00:03 2026-02-25T14:20:13.786 INFO:teuthology.orchestra.run.trial031.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 185 kB/s | 72 kB 00:00 2026-02-25T14:20:13.839 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:25 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:13.927 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout:====================================================================================== 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout:====================================================================================== 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout: ceph x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.5 k 2026-02-25T14:20:13.930 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-grafana-dashboards noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 43 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.3 M 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 961 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 290 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.0 M 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 17 M 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: ceph-prometheus-alerts noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 17 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 1.0 M 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:20:13.931 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:20:13.932 INFO:teuthology.orchestra.run.trial068.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:20:13.933 INFO:teuthology.orchestra.run.trial068.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:20:13.934 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:20:13.935 INFO:teuthology.orchestra.run.trial068.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:20:13.936 INFO:teuthology.orchestra.run.trial068.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T14:20:13.937 INFO:teuthology.orchestra.run.trial068.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout:Installing weak dependencies: 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 173 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-dashboard noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 11 M 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 7.4 M 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 22 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-rook noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 50 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: ceph-volume noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 297 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T14:20:13.938 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:13.939 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:13.939 INFO:teuthology.orchestra.run.trial068.stdout:====================================================================================== 2026-02-25T14:20:13.939 INFO:teuthology.orchestra.run.trial068.stdout:Install 95 Packages 2026-02-25T14:20:13.939 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:13.940 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 101 M 2026-02-25T14:20:13.940 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 561 M 2026-02-25T14:20:13.940 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:14.165 INFO:teuthology.orchestra.run.trial031.stdout:(18/95): cryptsetup-2.8.1-3.el9.x86_64.rpm 217 kB/s | 351 kB 00:01 2026-02-25T14:20:14.409 INFO:teuthology.orchestra.run.trial031.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 296 kB/s | 184 kB 00:00 2026-02-25T14:20:14.702 INFO:teuthology.orchestra.run.trial068.stdout:(1/95): ceph-20.2.0-676.gc824a7fa.el9.x86_64.rp 22 kB/s | 6.5 kB 00:00 2026-02-25T14:20:14.789 INFO:teuthology.orchestra.run.trial031.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 406 kB/s | 253 kB 00:00 2026-02-25T14:20:14.827 INFO:teuthology.orchestra.run.trial072.stdout:(7/95): ceph-mgr-dashboard-20.2.0-676.gc824a7fa 3.2 MB/s | 11 MB 00:03 2026-02-25T14:20:14.895 INFO:teuthology.orchestra.run.trial072.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-676.gc824a7fa 325 kB/s | 22 kB 00:00 2026-02-25T14:20:15.100 INFO:teuthology.orchestra.run.trial031.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 562 kB/s | 794 kB 00:01 2026-02-25T14:20:15.102 INFO:teuthology.orchestra.run.trial031.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 340 kB/s | 106 kB 00:00 2026-02-25T14:20:15.168 INFO:teuthology.orchestra.run.trial072.stdout:(9/95): ceph-mgr-modules-core-20.2.0-676.gc824a 1.0 MB/s | 290 kB 00:00 2026-02-25T14:20:15.211 INFO:teuthology.orchestra.run.trial068.stdout:(2/95): ceph-mgr-20.2.0-676.gc824a7fa.el9.x86_6 1.2 MB/s | 961 kB 00:00 2026-02-25T14:20:15.230 INFO:teuthology.orchestra.run.trial072.stdout:(10/95): ceph-mgr-rook-20.2.0-676.gc824a7fa.el9 819 kB/s | 50 kB 00:00 2026-02-25T14:20:15.294 INFO:teuthology.orchestra.run.trial072.stdout:(11/95): ceph-prometheus-alerts-20.2.0-676.gc82 271 kB/s | 17 kB 00:00 2026-02-25T14:20:15.383 INFO:teuthology.orchestra.run.trial068.stdout:(3/95): ceph-mds-20.2.0-676.gc824a7fa.el9.x86_6 2.4 MB/s | 2.3 MB 00:00 2026-02-25T14:20:15.413 INFO:teuthology.orchestra.run.trial031.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 431 kB/s | 135 kB 00:00 2026-02-25T14:20:15.441 INFO:teuthology.orchestra.run.trial068.stdout:(4/95): ceph-grafana-dashboards-20.2.0-676.gc82 743 kB/s | 43 kB 00:00 2026-02-25T14:20:15.481 INFO:teuthology.orchestra.run.trial072.stdout:(12/95): ceph-volume-20.2.0-676.gc824a7fa.el9.n 1.6 MB/s | 297 kB 00:00 2026-02-25T14:20:15.497 INFO:teuthology.orchestra.run.trial031.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 381 kB/s | 150 kB 00:00 2026-02-25T14:20:15.501 INFO:teuthology.orchestra.run.trial068.stdout:(5/95): ceph-mgr-cephadm-20.2.0-676.gc824a7fa.e 2.8 MB/s | 173 kB 00:00 2026-02-25T14:20:15.559 INFO:teuthology.orchestra.run.trial072.stdout:(13/95): ceph-mgr-diskprediction-local-20.2.0-6 1.9 MB/s | 7.4 MB 00:03 2026-02-25T14:20:15.691 INFO:teuthology.orchestra.run.trial072.stdout:(14/95): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.6 MB/s | 351 kB 00:00 2026-02-25T14:20:15.711 INFO:teuthology.orchestra.run.trial072.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 2.0 MB/s | 40 kB 00:00 2026-02-25T14:20:15.727 INFO:teuthology.orchestra.run.trial031.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 403 kB/s | 126 kB 00:00 2026-02-25T14:20:15.733 INFO:teuthology.orchestra.run.trial072.stdout:(16/95): libconfig-1.7.2-9.el9.x86_64.rpm 3.3 MB/s | 72 kB 00:00 2026-02-25T14:20:15.785 INFO:teuthology.orchestra.run.trial072.stdout:(17/95): libgfortran-11.5.0-14.el9.x86_64.rpm 15 MB/s | 794 kB 00:00 2026-02-25T14:20:15.807 INFO:teuthology.orchestra.run.trial072.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 8.0 MB/s | 184 kB 00:00 2026-02-25T14:20:15.830 INFO:teuthology.orchestra.run.trial072.stdout:(19/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 11 MB/s | 253 kB 00:00 2026-02-25T14:20:15.875 INFO:teuthology.orchestra.run.trial072.stdout:(20/95): python3-cryptography-36.0.1-5.el9.x86_ 28 MB/s | 1.2 MB 00:00 2026-02-25T14:20:15.889 INFO:teuthology.orchestra.run.trial031.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 555 kB/s | 218 kB 00:00 2026-02-25T14:20:15.896 INFO:teuthology.orchestra.run.trial072.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 4.9 MB/s | 106 kB 00:00 2026-02-25T14:20:15.918 INFO:teuthology.orchestra.run.trial072.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 6.1 MB/s | 135 kB 00:00 2026-02-25T14:20:15.940 INFO:teuthology.orchestra.run.trial072.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 6.8 MB/s | 150 kB 00:00 2026-02-25T14:20:15.962 INFO:teuthology.orchestra.run.trial072.stdout:(24/95): python3-requests-2.25.1-10.el9.noarch. 5.6 MB/s | 126 kB 00:00 2026-02-25T14:20:15.984 INFO:teuthology.orchestra.run.trial072.stdout:(25/95): python3-urllib3-1.26.5-7.el9.noarch.rp 9.6 MB/s | 218 kB 00:00 2026-02-25T14:20:16.007 INFO:teuthology.orchestra.run.trial072.stdout:(26/95): unzip-6.0-59.el9.x86_64.rpm 7.9 MB/s | 182 kB 00:00 2026-02-25T14:20:16.029 INFO:teuthology.orchestra.run.trial072.stdout:(27/95): zip-3.0-35.el9.x86_64.rpm 12 MB/s | 266 kB 00:00 2026-02-25T14:20:16.041 INFO:teuthology.orchestra.run.trial031.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 580 kB/s | 182 kB 00:00 2026-02-25T14:20:16.062 INFO:teuthology.orchestra.run.trial072.stdout:(28/95): cephadm-20.2.0-676.gc824a7fa.el9.noarc 1.7 MB/s | 1.0 MB 00:00 2026-02-25T14:20:16.275 INFO:teuthology.orchestra.run.trial031.stdout:(28/95): python3-cryptography-36.0.1-5.el9.x86_ 683 kB/s | 1.2 MB 00:01 2026-02-25T14:20:16.282 INFO:teuthology.orchestra.run.trial031.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 678 kB/s | 266 kB 00:00 2026-02-25T14:20:16.306 INFO:teuthology.orchestra.run.trial031.stdout:(30/95): flexiblas-3.0.4-9.el9.x86_64.rpm 112 kB/s | 30 kB 00:00 2026-02-25T14:20:16.500 INFO:teuthology.orchestra.run.trial072.stdout:(29/95): flexiblas-3.0.4-9.el9.x86_64.rpm 63 kB/s | 30 kB 00:00 2026-02-25T14:20:16.515 INFO:teuthology.orchestra.run.trial031.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-9.el9. 64 kB/s | 15 kB 00:00 2026-02-25T14:20:16.598 INFO:teuthology.orchestra.run.trial072.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 151 kB/s | 15 kB 00:00 2026-02-25T14:20:16.626 INFO:teuthology.orchestra.run.trial031.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 771 kB/s | 246 kB 00:00 2026-02-25T14:20:16.711 INFO:teuthology.orchestra.run.trial031.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 498 kB/s | 42 kB 00:00 2026-02-25T14:20:16.769 INFO:teuthology.orchestra.run.trial068.stdout:(6/95): ceph-mgr-dashboard-20.2.0-676.gc824a7fa 8.4 MB/s | 11 MB 00:01 2026-02-25T14:20:16.842 INFO:teuthology.orchestra.run.trial031.stdout:(34/95): lua-5.4.4-4.el9.x86_64.rpm 577 kB/s | 188 kB 00:00 2026-02-25T14:20:17.008 INFO:teuthology.orchestra.run.trial072.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 601 kB/s | 246 kB 00:00 2026-02-25T14:20:17.052 INFO:teuthology.orchestra.run.trial031.stdout:(35/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 3.9 MB/s | 3.0 MB 00:00 2026-02-25T14:20:17.139 INFO:teuthology.orchestra.run.trial031.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2026-02-25T14:20:17.148 INFO:teuthology.orchestra.run.trial031.stdout:(37/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 12 MB/s | 5.3 MB 00:00 2026-02-25T14:20:17.229 INFO:teuthology.orchestra.run.trial031.stdout:(38/95): python3-devel-3.9.25-3.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-25T14:20:17.230 INFO:teuthology.orchestra.run.trial031.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 3.0 MB/s | 249 kB 00:00 2026-02-25T14:20:17.262 INFO:teuthology.orchestra.run.trial072.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 741 kB/s | 188 kB 00:00 2026-02-25T14:20:17.270 INFO:teuthology.orchestra.run.trial031.stdout:(40/95): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2026-02-25T14:20:17.309 INFO:teuthology.orchestra.run.trial031.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 592 kB/s | 48 kB 00:00 2026-02-25T14:20:17.311 INFO:teuthology.orchestra.run.trial031.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-25T14:20:17.340 INFO:teuthology.orchestra.run.trial068.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-67 13 MB/s | 7.4 MB 00:00 2026-02-25T14:20:17.359 INFO:teuthology.orchestra.run.trial031.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2026-02-25T14:20:17.360 INFO:teuthology.orchestra.run.trial072.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 428 kB/s | 42 kB 00:00 2026-02-25T14:20:17.389 INFO:teuthology.orchestra.run.trial031.stdout:(44/95): python3-markupsafe-1.1.1-12.el9.x86_64 438 kB/s | 35 kB 00:00 2026-02-25T14:20:17.397 INFO:teuthology.orchestra.run.trial068.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-676.gc824a7fa 391 kB/s | 22 kB 00:00 2026-02-25T14:20:17.441 INFO:teuthology.orchestra.run.trial031.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.3 MB/s | 442 kB 00:00 2026-02-25T14:20:17.457 INFO:teuthology.orchestra.run.trial068.stdout:(9/95): ceph-mgr-modules-core-20.2.0-676.gc824a 4.7 MB/s | 290 kB 00:00 2026-02-25T14:20:17.470 INFO:teuthology.orchestra.run.trial031.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 948 kB/s | 77 kB 00:00 2026-02-25T14:20:17.507 INFO:teuthology.orchestra.run.trial031.stdout:(47/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 31 MB/s | 6.1 MB 00:00 2026-02-25T14:20:17.515 INFO:teuthology.orchestra.run.trial068.stdout:(10/95): ceph-mgr-rook-20.2.0-676.gc824a7fa.el9 866 kB/s | 50 kB 00:00 2026-02-25T14:20:17.522 INFO:teuthology.orchestra.run.trial031.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 3.2 MB/s | 267 kB 00:00 2026-02-25T14:20:17.556 INFO:teuthology.orchestra.run.trial031.stdout:(49/95): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.8 MB/s | 157 kB 00:00 2026-02-25T14:20:17.572 INFO:teuthology.orchestra.run.trial068.stdout:(11/95): ceph-prometheus-alerts-20.2.0-676.gc82 308 kB/s | 17 kB 00:00 2026-02-25T14:20:17.588 INFO:teuthology.orchestra.run.trial031.stdout:(50/95): python3-pyasn1-modules-0.4.8-7.el9.noa 3.3 MB/s | 277 kB 00:00 2026-02-25T14:20:17.601 INFO:teuthology.orchestra.run.trial031.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 680 kB/s | 54 kB 00:00 2026-02-25T14:20:17.637 INFO:teuthology.orchestra.run.trial068.stdout:(12/95): ceph-volume-20.2.0-676.gc824a7fa.el9.n 4.5 MB/s | 297 kB 00:00 2026-02-25T14:20:17.667 INFO:teuthology.orchestra.run.trial031.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 526 kB/s | 42 kB 00:00 2026-02-25T14:20:17.680 INFO:teuthology.orchestra.run.trial031.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-25T14:20:17.739 INFO:teuthology.orchestra.run.trial031.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2026-02-25T14:20:17.746 INFO:teuthology.orchestra.run.trial031.stdout:(55/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-25T14:20:17.828 INFO:teuthology.orchestra.run.trial068.stdout:(13/95): cephadm-20.2.0-676.gc824a7fa.el9.noarc 5.2 MB/s | 1.0 MB 00:00 2026-02-25T14:20:17.838 INFO:teuthology.orchestra.run.trial031.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 8.5 MB/s | 862 kB 00:00 2026-02-25T14:20:17.867 INFO:teuthology.orchestra.run.trial068.stdout:(14/95): ceph-mon-20.2.0-676.gc824a7fa.el9.x86_ 1.6 MB/s | 5.0 MB 00:03 2026-02-25T14:20:18.055 INFO:teuthology.orchestra.run.trial031.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 90 kB/s | 19 kB 00:00 2026-02-25T14:20:18.235 INFO:teuthology.orchestra.run.trial031.stdout:(58/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.1 MB/s | 551 kB 00:00 2026-02-25T14:20:18.270 INFO:teuthology.orchestra.run.trial068.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 100 kB/s | 40 kB 00:00 2026-02-25T14:20:18.295 INFO:teuthology.orchestra.run.trial031.stdout:(59/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 26 MB/s | 19 MB 00:00 2026-02-25T14:20:18.402 INFO:teuthology.orchestra.run.trial031.stdout:(60/95): luarocks-3.9.2-5.el9.noarch.rpm 436 kB/s | 151 kB 00:00 2026-02-25T14:20:18.433 INFO:teuthology.orchestra.run.trial068.stdout:(16/95): libconfig-1.7.2-9.el9.x86_64.rpm 445 kB/s | 72 kB 00:00 2026-02-25T14:20:18.510 INFO:teuthology.orchestra.run.trial031.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 137 kB/s | 29 kB 00:00 2026-02-25T14:20:18.633 INFO:teuthology.orchestra.run.trial068.stdout:(17/95): cryptsetup-2.8.1-3.el9.x86_64.rpm 436 kB/s | 351 kB 00:00 2026-02-25T14:20:18.691 INFO:teuthology.orchestra.run.trial031.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 208 kB/s | 60 kB 00:00 2026-02-25T14:20:18.721 INFO:teuthology.orchestra.run.trial031.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 206 kB/s | 43 kB 00:00 2026-02-25T14:20:18.741 INFO:teuthology.orchestra.run.trial031.stdout:(64/95): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-25T14:20:18.862 INFO:teuthology.orchestra.run.trial031.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 100 kB/s | 14 kB 00:00 2026-02-25T14:20:18.873 INFO:teuthology.orchestra.run.trial068.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 768 kB/s | 184 kB 00:00 2026-02-25T14:20:18.907 INFO:teuthology.orchestra.run.trial031.stdout:(66/95): python3-cachetools-4.2.4-1.el9.noarch. 149 kB/s | 32 kB 00:00 2026-02-25T14:20:19.100 INFO:teuthology.orchestra.run.trial031.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 483 kB/s | 173 kB 00:00 2026-02-25T14:20:19.193 INFO:teuthology.orchestra.run.trial068.stdout:(19/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 793 kB/s | 253 kB 00:00 2026-02-25T14:20:19.279 INFO:teuthology.orchestra.run.trial031.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 860 kB/s | 358 kB 00:00 2026-02-25T14:20:19.340 INFO:teuthology.orchestra.run.trial031.stdout:(69/95): python3-google-auth-2.45.0-1.el9.noarc 587 kB/s | 254 kB 00:00 2026-02-25T14:20:19.379 INFO:teuthology.orchestra.run.trial068.stdout:(20/95): libgfortran-11.5.0-14.el9.x86_64.rpm 840 kB/s | 794 kB 00:00 2026-02-25T14:20:19.542 INFO:teuthology.orchestra.run.trial068.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 656 kB/s | 106 kB 00:00 2026-02-25T14:20:19.637 INFO:teuthology.orchestra.run.trial031.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 404 kB/s | 144 kB 00:00 2026-02-25T14:20:19.691 INFO:teuthology.orchestra.run.trial031.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 396 kB/s | 139 kB 00:00 2026-02-25T14:20:19.704 INFO:teuthology.orchestra.run.trial068.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 832 kB/s | 135 kB 00:00 2026-02-25T14:20:19.822 INFO:teuthology.orchestra.run.trial031.stdout:(72/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.8 MB/s | 2.0 MB 00:00 2026-02-25T14:20:19.831 INFO:teuthology.orchestra.run.trial031.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 77 kB/s | 11 kB 00:00 2026-02-25T14:20:19.924 INFO:teuthology.orchestra.run.trial031.stdout:(74/95): python3-isodate-0.6.1-3.el9.noarch.rpm 195 kB/s | 56 kB 00:00 2026-02-25T14:20:19.945 INFO:teuthology.orchestra.run.trial068.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 625 kB/s | 150 kB 00:00 2026-02-25T14:20:19.951 INFO:teuthology.orchestra.run.trial072.stdout:(34/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 787 kB/s | 3.0 MB 00:03 2026-02-25T14:20:20.037 INFO:teuthology.orchestra.run.trial031.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 82 kB/s | 18 kB 00:00 2026-02-25T14:20:20.046 INFO:teuthology.orchestra.run.trial031.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 108 kB/s | 23 kB 00:00 2026-02-25T14:20:20.112 INFO:teuthology.orchestra.run.trial068.stdout:(24/95): python3-requests-2.25.1-10.el9.noarch. 759 kB/s | 126 kB 00:00 2026-02-25T14:20:20.140 INFO:teuthology.orchestra.run.trial031.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 91 kB/s | 20 kB 00:00 2026-02-25T14:20:20.251 INFO:teuthology.orchestra.run.trial031.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 90 kB/s | 19 kB 00:00 2026-02-25T14:20:20.258 INFO:teuthology.orchestra.run.trial031.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 124 kB/s | 26 kB 00:00 2026-02-25T14:20:20.435 INFO:teuthology.orchestra.run.trial068.stdout:(25/95): python3-urllib3-1.26.5-7.el9.noarch.rp 673 kB/s | 218 kB 00:00 2026-02-25T14:20:20.539 INFO:teuthology.orchestra.run.trial031.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 307 kB/s | 86 kB 00:00 2026-02-25T14:20:20.541 INFO:teuthology.orchestra.run.trial031.stdout:(81/95): python3-more-itertools-8.12.0-2.el9.no 272 kB/s | 79 kB 00:00 2026-02-25T14:20:20.678 INFO:teuthology.orchestra.run.trial068.stdout:(26/95): unzip-6.0-59.el9.x86_64.rpm 749 kB/s | 182 kB 00:00 2026-02-25T14:20:20.707 INFO:teuthology.orchestra.run.trial068.stdout:(27/95): python3-cryptography-36.0.1-5.el9.x86_ 842 kB/s | 1.2 MB 00:01 2026-02-25T14:20:20.708 INFO:teuthology.orchestra.run.trial031.stdout:(82/95): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-25T14:20:20.756 INFO:teuthology.orchestra.run.trial031.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 76 kB/s | 16 kB 00:00 2026-02-25T14:20:20.826 INFO:teuthology.orchestra.run.trial031.stdout:(84/95): python3-natsort-7.1.1-5.el9.noarch.rpm 201 kB/s | 58 kB 00:00 2026-02-25T14:20:20.830 INFO:teuthology.orchestra.run.trial068.stdout:(28/95): flexiblas-3.0.4-9.el9.x86_64.rpm 240 kB/s | 30 kB 00:00 2026-02-25T14:20:20.974 INFO:teuthology.orchestra.run.trial031.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 141 kB/s | 31 kB 00:00 2026-02-25T14:20:20.997 INFO:teuthology.orchestra.run.trial068.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 833 kB/s | 266 kB 00:00 2026-02-25T14:20:20.998 INFO:teuthology.orchestra.run.trial031.stdout:(86/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 310 kB/s | 90 kB 00:00 2026-02-25T14:20:21.097 INFO:teuthology.orchestra.run.trial068.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 149 kB/s | 15 kB 00:00 2026-02-25T14:20:21.164 INFO:teuthology.orchestra.run.trial072.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 848 kB/s | 1.0 MB 00:01 2026-02-25T14:20:21.175 INFO:teuthology.orchestra.run.trial031.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 540 kB/s | 188 kB 00:00 2026-02-25T14:20:21.255 INFO:teuthology.orchestra.run.trial031.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 210 kB/s | 59 kB 00:00 2026-02-25T14:20:21.346 INFO:teuthology.orchestra.run.trial031.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 360 kB/s | 125 kB 00:00 2026-02-25T14:20:21.386 INFO:teuthology.orchestra.run.trial031.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 171 kB/s | 36 kB 00:00 2026-02-25T14:20:21.432 INFO:teuthology.orchestra.run.trial068.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 737 kB/s | 246 kB 00:00 2026-02-25T14:20:21.534 INFO:teuthology.orchestra.run.trial031.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 310 kB/s | 86 kB 00:00 2026-02-25T14:20:21.632 INFO:teuthology.orchestra.run.trial031.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 313 kB/s | 90 kB 00:00 2026-02-25T14:20:21.664 INFO:teuthology.orchestra.run.trial031.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 174 kB/s | 48 kB 00:00 2026-02-25T14:20:21.688 INFO:teuthology.orchestra.run.trial068.stdout:(32/95): lua-5.4.4-4.el9.x86_64.rpm 735 kB/s | 188 kB 00:00 2026-02-25T14:20:21.751 INFO:teuthology.orchestra.run.trial031.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 102 kB/s | 22 kB 00:00 2026-02-25T14:20:21.787 INFO:teuthology.orchestra.run.trial068.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 425 kB/s | 42 kB 00:00 2026-02-25T14:20:21.843 INFO:teuthology.orchestra.run.trial068.stdout:(34/95): ceph-osd-20.2.0-676.gc824a7fa.el9.x86_ 2.6 MB/s | 17 MB 00:06 2026-02-25T14:20:21.847 INFO:teuthology.orchestra.run.trial031.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 93 kB/s | 20 kB 00:00 2026-02-25T14:20:21.852 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:21.852 INFO:teuthology.orchestra.run.trial031.stdout:Total 7.9 MB/s | 101 MB 00:12 2026-02-25T14:20:22.286 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:22.324 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:22.324 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:22.759 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:22.759 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:23.042 INFO:teuthology.orchestra.run.trial068.stdout:(35/95): protobuf-3.14.0-17.el9.x86_64.rpm 858 kB/s | 1.0 MB 00:01 2026-02-25T14:20:23.233 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:23.235 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-25T14:20:23.239 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-25T14:20:23.260 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-25T14:20:23.294 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/95 2026-02-25T14:20:23.303 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-25T14:20:23.310 INFO:teuthology.orchestra.run.trial031.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-25T14:20:23.312 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-25T14:20:23.316 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-25T14:20:23.340 INFO:teuthology.orchestra.run.trial031.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-25T14:20:23.352 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-25T14:20:23.355 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-25T14:20:23.363 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-25T14:20:23.365 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-25T14:20:23.376 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-25T14:20:23.382 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-25T14:20:23.405 INFO:teuthology.orchestra.run.trial072.stdout:(36/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 895 kB/s | 5.3 MB 00:06 2026-02-25T14:20:23.406 INFO:teuthology.orchestra.run.trial031.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-25T14:20:23.409 INFO:teuthology.orchestra.run.trial031.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-25T14:20:23.416 INFO:teuthology.orchestra.run.trial031.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-25T14:20:23.466 INFO:teuthology.orchestra.run.trial031.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-25T14:20:23.479 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 20/95 2026-02-25T14:20:23.482 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-25T14:20:23.486 INFO:teuthology.orchestra.run.trial031.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-25T14:20:23.491 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-25T14:20:23.496 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-25T14:20:23.499 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-25T14:20:23.514 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-25T14:20:23.518 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-25T14:20:23.523 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-25T14:20:23.534 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-25T14:20:23.543 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-25T14:20:23.544 INFO:teuthology.orchestra.run.trial068.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2026-02-25T14:20:23.549 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-25T14:20:23.568 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-25T14:20:23.579 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-25T14:20:23.595 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-25T14:20:23.600 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-25T14:20:23.608 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-25T14:20:23.644 INFO:teuthology.orchestra.run.trial068.stdout:(37/95): python3-devel-3.9.25-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2026-02-25T14:20:23.647 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-25T14:20:23.745 INFO:teuthology.orchestra.run.trial068.stdout:(38/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.4 MB/s | 249 kB 00:00 2026-02-25T14:20:23.745 INFO:teuthology.orchestra.run.trial072.stdout:(37/95): python3-devel-3.9.25-3.el9.x86_64.rpm 720 kB/s | 244 kB 00:00 2026-02-25T14:20:23.843 INFO:teuthology.orchestra.run.trial068.stdout:(39/95): python3-jmespath-1.0.1-1.el9.noarch.rp 481 kB/s | 48 kB 00:00 2026-02-25T14:20:23.944 INFO:teuthology.orchestra.run.trial068.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 1.7 MB/s | 177 kB 00:00 2026-02-25T14:20:23.969 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-25T14:20:23.979 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-25T14:20:23.983 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-25T14:20:23.988 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-25T14:20:23.990 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-25T14:20:24.017 INFO:teuthology.orchestra.run.trial031.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-25T14:20:24.059 INFO:teuthology.orchestra.run.trial072.stdout:(38/95): ceph-osd-20.2.0-676.gc824a7fa.el9.x86_ 1.3 MB/s | 17 MB 00:13 2026-02-25T14:20:24.060 INFO:teuthology.orchestra.run.trial031.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-25T14:20:24.067 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-25T14:20:24.071 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-25T14:20:24.076 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-25T14:20:24.080 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-25T14:20:24.082 INFO:teuthology.orchestra.run.trial072.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 737 kB/s | 249 kB 00:00 2026-02-25T14:20:24.087 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-25T14:20:24.090 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-25T14:20:24.118 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-25T14:20:24.124 INFO:teuthology.orchestra.run.trial068.stdout:(41/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.8 MB/s | 1.2 MB 00:00 2026-02-25T14:20:24.127 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-25T14:20:24.133 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-25T14:20:24.140 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-25T14:20:24.174 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-25T14:20:24.224 INFO:teuthology.orchestra.run.trial068.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 350 kB/s | 35 kB 00:00 2026-02-25T14:20:24.344 INFO:teuthology.orchestra.run.trial072.stdout:(40/95): python3-libstoragemgmt-1.10.1-1.el9.x8 677 kB/s | 177 kB 00:00 2026-02-25T14:20:24.351 INFO:teuthology.orchestra.run.trial068.stdout:(43/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 869 kB/s | 3.0 MB 00:03 2026-02-25T14:20:24.398 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 56/95 2026-02-25T14:20:24.421 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-25T14:20:24.425 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-25T14:20:24.484 INFO:teuthology.orchestra.run.trial031.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-25T14:20:24.486 INFO:teuthology.orchestra.run.trial031.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-25T14:20:24.507 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-25T14:20:24.553 INFO:teuthology.orchestra.run.trial072.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 96 kB/s | 48 kB 00:00 2026-02-25T14:20:24.727 INFO:teuthology.orchestra.run.trial068.stdout:(44/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 12 MB/s | 6.1 MB 00:00 2026-02-25T14:20:24.810 INFO:teuthology.orchestra.run.trial072.stdout:(42/95): python3-markupsafe-1.1.1-12.el9.x86_64 136 kB/s | 35 kB 00:00 2026-02-25T14:20:24.827 INFO:teuthology.orchestra.run.trial068.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 775 kB/s | 77 kB 00:00 2026-02-25T14:20:24.830 INFO:teuthology.orchestra.run.trial031.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-25T14:20:24.847 INFO:teuthology.orchestra.run.trial068.stdout:(46/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 1.7 MB/s | 5.3 MB 00:03 2026-02-25T14:20:24.903 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-25T14:20:24.929 INFO:teuthology.orchestra.run.trial068.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 2.6 MB/s | 267 kB 00:00 2026-02-25T14:20:24.932 INFO:teuthology.orchestra.run.trial068.stdout:(48/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 760 kB/s | 442 kB 00:00 2026-02-25T14:20:24.965 INFO:teuthology.orchestra.run.trial068.stdout:(49/95): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.3 MB/s | 157 kB 00:00 2026-02-25T14:20:25.032 INFO:teuthology.orchestra.run.trial068.stdout:(50/95): python3-requests-oauthlib-1.3.0-12.el9 539 kB/s | 54 kB 00:00 2026-02-25T14:20:25.132 INFO:teuthology.orchestra.run.trial068.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2026-02-25T14:20:25.232 INFO:teuthology.orchestra.run.trial068.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.8 MB/s | 189 kB 00:00 2026-02-25T14:20:25.264 INFO:teuthology.orchestra.run.trial068.stdout:(53/95): python3-pyasn1-modules-0.4.8-7.el9.noa 827 kB/s | 277 kB 00:00 2026-02-25T14:20:25.332 INFO:teuthology.orchestra.run.trial068.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 908 kB/s | 90 kB 00:00 2026-02-25T14:20:25.463 INFO:teuthology.orchestra.run.trial021.stdout:(5/5): ceph-test-20.2.0-676.gc824a7fa.el9.x86_6 4.1 MB/s | 84 MB 00:20 2026-02-25T14:20:25.464 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:25.464 INFO:teuthology.orchestra.run.trial021.stdout:Total 4.2 MB/s | 85 MB 00:20 2026-02-25T14:20:25.490 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:25.499 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:25.500 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:25.571 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-25T14:20:25.588 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-25T14:20:25.598 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-25T14:20:25.605 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-25T14:20:25.618 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-25T14:20:25.634 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-25T14:20:25.709 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-25T14:20:25.717 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-25T14:20:25.740 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-25T14:20:25.773 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-25T14:20:25.787 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:25.787 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:25.806 INFO:teuthology.orchestra.run.trial072.stdout:(43/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 856 kB/s | 1.2 MB 00:01 2026-02-25T14:20:25.823 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-25T14:20:25.824 INFO:teuthology.orchestra.run.trial068.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-25T14:20:25.829 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-25T14:20:25.832 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-25T14:20:25.833 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-25T14:20:25.852 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:25.852 INFO:teuthology.orchestra.run.trial031.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:20:25.853 INFO:teuthology.orchestra.run.trial031.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:20:25.853 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:25.861 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:25.888 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:25.888 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:20:25.888 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:25.922 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-25T14:20:25.986 INFO:teuthology.orchestra.run.trial031.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 80/95 2026-02-25T14:20:25.988 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:26.002 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:26.002 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:26.002 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:20:26.002 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:26.005 INFO:teuthology.orchestra.run.trial068.stdout:(56/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.0 MB/s | 551 kB 00:00 2026-02-25T14:20:26.033 INFO:teuthology.orchestra.run.trial068.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 701 kB/s | 19 kB 00:00 2026-02-25T14:20:26.063 INFO:teuthology.orchestra.run.trial068.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 5.0 MB/s | 151 kB 00:00 2026-02-25T14:20:26.070 INFO:teuthology.orchestra.run.trial072.stdout:(44/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 1.6 MB/s | 442 kB 00:00 2026-02-25T14:20:26.094 INFO:teuthology.orchestra.run.trial068.stdout:(59/95): python3-asyncssh-2.13.2-5.el9.noarch.r 17 MB/s | 548 kB 00:00 2026-02-25T14:20:26.100 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:26.105 INFO:teuthology.orchestra.run.trial021.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T14:20:26.109 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T14:20:26.117 INFO:teuthology.orchestra.run.trial021.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T14:20:26.118 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:26.123 INFO:teuthology.orchestra.run.trial068.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 1.0 MB/s | 29 kB 00:00 2026-02-25T14:20:26.151 INFO:teuthology.orchestra.run.trial068.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 2.1 MB/s | 60 kB 00:00 2026-02-25T14:20:26.169 INFO:teuthology.orchestra.run.trial072.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 777 kB/s | 77 kB 00:00 2026-02-25T14:20:26.179 INFO:teuthology.orchestra.run.trial068.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.5 MB/s | 43 kB 00:00 2026-02-25T14:20:26.206 INFO:teuthology.orchestra.run.trial068.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 1.1 MB/s | 32 kB 00:00 2026-02-25T14:20:26.241 INFO:teuthology.orchestra.run.trial068.stdout:(64/95): protobuf-compiler-3.14.0-17.el9.x86_64 948 kB/s | 862 kB 00:00 2026-02-25T14:20:26.242 INFO:teuthology.orchestra.run.trial068.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 403 kB/s | 14 kB 00:00 2026-02-25T14:20:26.271 INFO:teuthology.orchestra.run.trial068.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 5.8 MB/s | 173 kB 00:00 2026-02-25T14:20:26.278 INFO:teuthology.orchestra.run.trial072.stdout:(46/95): python3-protobuf-3.14.0-17.el9.noarch. 2.4 MB/s | 267 kB 00:00 2026-02-25T14:20:26.302 INFO:teuthology.orchestra.run.trial068.stdout:(67/95): python3-google-auth-2.45.0-1.el9.noarc 7.8 MB/s | 254 kB 00:00 2026-02-25T14:20:26.361 INFO:teuthology.orchestra.run.trial068.stdout:(68/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 35 MB/s | 2.0 MB 00:00 2026-02-25T14:20:26.383 INFO:teuthology.orchestra.run.trial072.stdout:(47/95): python3-pyasn1-0.4.8-7.el9.noarch.rpm 1.5 MB/s | 157 kB 00:00 2026-02-25T14:20:26.389 INFO:teuthology.orchestra.run.trial068.stdout:(69/95): python3-cherrypy-18.6.1-2.el9.noarch.r 2.4 MB/s | 358 kB 00:00 2026-02-25T14:20:26.391 INFO:teuthology.orchestra.run.trial068.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 4.7 MB/s | 144 kB 00:00 2026-02-25T14:20:26.430 INFO:teuthology.orchestra.run.trial068.stdout:(71/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-25T14:20:26.431 INFO:teuthology.orchestra.run.trial068.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.4 MB/s | 56 kB 00:00 2026-02-25T14:20:26.431 INFO:teuthology.orchestra.run.trial068.stdout:(73/95): python3-influxdb-5.3.1-1.el9.noarch.rp 3.2 MB/s | 139 kB 00:00 2026-02-25T14:20:26.458 INFO:teuthology.orchestra.run.trial068.stdout:(74/95): python3-jaraco-collections-3.0.0-8.el9 858 kB/s | 23 kB 00:00 2026-02-25T14:20:26.459 INFO:teuthology.orchestra.run.trial068.stdout:(75/95): python3-jaraco-classes-3.2.1-5.el9.noa 630 kB/s | 18 kB 00:00 2026-02-25T14:20:26.478 INFO:teuthology.orchestra.run.trial068.stdout:(76/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 223 kB/s | 11 kB 00:00 2026-02-25T14:20:26.483 INFO:teuthology.orchestra.run.trial072.stdout:(48/95): python3-pyasn1-modules-0.4.8-7.el9.noa 2.7 MB/s | 277 kB 00:00 2026-02-25T14:20:26.486 INFO:teuthology.orchestra.run.trial068.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 725 kB/s | 19 kB 00:00 2026-02-25T14:20:26.486 INFO:teuthology.orchestra.run.trial068.stdout:(78/95): python3-jaraco-context-6.0.1-3.el9.noa 712 kB/s | 20 kB 00:00 2026-02-25T14:20:26.515 INFO:teuthology.orchestra.run.trial068.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 2.7 MB/s | 79 kB 00:00 2026-02-25T14:20:26.517 INFO:teuthology.orchestra.run.trial068.stdout:(80/95): python3-kubernetes-26.1.0-3.el9.noarch 33 MB/s | 1.0 MB 00:00 2026-02-25T14:20:26.526 INFO:teuthology.orchestra.run.trial068.stdout:(81/95): python3-jaraco-text-4.0.0-2.el9.noarch 553 kB/s | 26 kB 00:00 2026-02-25T14:20:26.543 INFO:teuthology.orchestra.run.trial068.stdout:(82/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.0 MB/s | 86 kB 00:00 2026-02-25T14:20:26.545 INFO:teuthology.orchestra.run.trial068.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 2.1 MB/s | 58 kB 00:00 2026-02-25T14:20:26.551 INFO:teuthology.orchestra.run.trial068.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 653 kB/s | 16 kB 00:00 2026-02-25T14:20:26.572 INFO:teuthology.orchestra.run.trial068.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.1 MB/s | 90 kB 00:00 2026-02-25T14:20:26.572 INFO:teuthology.orchestra.run.trial068.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.1 MB/s | 31 kB 00:00 2026-02-25T14:20:26.582 INFO:teuthology.orchestra.run.trial072.stdout:(49/95): python3-requests-oauthlib-1.3.0-12.el9 541 kB/s | 54 kB 00:00 2026-02-25T14:20:26.600 INFO:teuthology.orchestra.run.trial068.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 2.1 MB/s | 59 kB 00:00 2026-02-25T14:20:26.601 INFO:teuthology.orchestra.run.trial068.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 4.2 MB/s | 125 kB 00:00 2026-02-25T14:20:26.625 INFO:teuthology.orchestra.run.trial068.stdout:(89/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2026-02-25T14:20:26.628 INFO:teuthology.orchestra.run.trial068.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.3 MB/s | 36 kB 00:00 2026-02-25T14:20:26.629 INFO:teuthology.orchestra.run.trial068.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 3.1 MB/s | 86 kB 00:00 2026-02-25T14:20:26.652 INFO:teuthology.orchestra.run.trial068.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 3.2 MB/s | 90 kB 00:00 2026-02-25T14:20:26.660 INFO:teuthology.orchestra.run.trial068.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 707 kB/s | 22 kB 00:00 2026-02-25T14:20:26.662 INFO:teuthology.orchestra.run.trial068.stdout:(94/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.4 MB/s | 48 kB 00:00 2026-02-25T14:20:26.678 INFO:teuthology.orchestra.run.trial068.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 758 kB/s | 20 kB 00:00 2026-02-25T14:20:26.683 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:26.684 INFO:teuthology.orchestra.run.trial068.stdout:Total 8.0 MB/s | 101 MB 00:12 2026-02-25T14:20:26.703 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:26.728 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:26.787 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:26.789 INFO:teuthology.orchestra.run.trial031.stdout: Installing : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:26.796 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 84/95 2026-02-25T14:20:26.819 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 85/95 2026-02-25T14:20:26.820 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:27.090 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:27.127 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:27.127 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:27.560 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:27.560 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:27.893 INFO:teuthology.orchestra.run.trial072.stdout:(50/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 15 MB/s | 19 MB 00:01 2026-02-25T14:20:27.974 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:27.979 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:27.992 INFO:teuthology.orchestra.run.trial072.stdout:(51/95): python3-toml-0.10.2-6.el9.noarch.rpm 420 kB/s | 42 kB 00:00 2026-02-25T14:20:28.026 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:28.028 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-25T14:20:28.032 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-25T14:20:28.053 INFO:teuthology.orchestra.run.trial068.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-25T14:20:28.088 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/95 2026-02-25T14:20:28.091 INFO:teuthology.orchestra.run.trial072.stdout:(52/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.9 MB/s | 189 kB 00:00 2026-02-25T14:20:28.097 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-25T14:20:28.102 INFO:teuthology.orchestra.run.trial068.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-25T14:20:28.104 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-25T14:20:28.109 INFO:teuthology.orchestra.run.trial068.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-25T14:20:28.132 INFO:teuthology.orchestra.run.trial068.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-25T14:20:28.135 INFO:teuthology.orchestra.run.trial072.stdout:(53/95): python3-babel-2.9.1-2.el9.noarch.rpm 876 kB/s | 6.0 MB 00:06 2026-02-25T14:20:28.144 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-25T14:20:28.147 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-25T14:20:28.153 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-25T14:20:28.155 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-25T14:20:28.166 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-25T14:20:28.172 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-25T14:20:28.190 INFO:teuthology.orchestra.run.trial072.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 910 kB/s | 90 kB 00:00 2026-02-25T14:20:28.196 INFO:teuthology.orchestra.run.trial068.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-25T14:20:28.199 INFO:teuthology.orchestra.run.trial068.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-25T14:20:28.206 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-25T14:20:28.258 INFO:teuthology.orchestra.run.trial068.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-25T14:20:28.270 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 20/95 2026-02-25T14:20:28.274 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-25T14:20:28.279 INFO:teuthology.orchestra.run.trial068.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-25T14:20:28.284 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-25T14:20:28.289 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-25T14:20:28.292 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-25T14:20:28.307 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-25T14:20:28.311 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-25T14:20:28.315 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-25T14:20:28.327 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-25T14:20:28.336 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-25T14:20:28.342 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-25T14:20:28.361 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-25T14:20:28.372 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-25T14:20:28.373 INFO:teuthology.orchestra.run.trial072.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:28.388 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-25T14:20:28.392 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-25T14:20:28.400 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-25T14:20:28.428 INFO:teuthology.orchestra.run.trial072.stdout:[MIRROR] protobuf-compiler-3.14.0-17.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-17.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:28.440 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-25T14:20:28.451 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:28.452 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:28.465 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:28.466 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:28.523 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:28.568 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 90/95 2026-02-25T14:20:28.569 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:28.590 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:28.601 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:28.765 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-25T14:20:28.774 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-25T14:20:28.778 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-25T14:20:28.784 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-25T14:20:28.786 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-25T14:20:28.813 INFO:teuthology.orchestra.run.trial068.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-25T14:20:28.842 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:28.843 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:28.856 INFO:teuthology.orchestra.run.trial068.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-25T14:20:28.862 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-25T14:20:28.865 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:28.865 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:28.865 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:20:28.865 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:28.866 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:28.866 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:28.866 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-25T14:20:28.872 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-25T14:20:28.875 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-25T14:20:28.882 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-25T14:20:28.886 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-25T14:20:28.913 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-25T14:20:28.923 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-25T14:20:28.929 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-25T14:20:28.936 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-25T14:20:28.965 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:28.970 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-25T14:20:28.987 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:28.987 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:28.987 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:20:28.987 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:28.987 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:28.988 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:29.007 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:29.012 INFO:teuthology.orchestra.run.trial072.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:29.069 INFO:teuthology.orchestra.run.trial072.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 24 kB/s | 22 kB 00:00 2026-02-25T14:20:29.071 INFO:teuthology.orchestra.run.trial072.stdout:[MIRROR] protobuf-compiler-3.14.0-17.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-17.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-25T14:20:29.163 INFO:teuthology.orchestra.run.trial072.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 887 kB/s | 862 kB 00:00 2026-02-25T14:20:29.193 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 56/95 2026-02-25T14:20:29.217 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-25T14:20:29.221 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-25T14:20:29.235 INFO:teuthology.orchestra.run.trial072.stdout:(57/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.2 MB/s | 551 kB 00:00 2026-02-25T14:20:29.236 INFO:teuthology.orchestra.run.trial072.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 267 kB/s | 19 kB 00:00 2026-02-25T14:20:29.258 INFO:teuthology.orchestra.run.trial072.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 6.6 MB/s | 151 kB 00:00 2026-02-25T14:20:29.276 INFO:teuthology.orchestra.run.trial072.stdout:(60/95): python3-asyncssh-2.13.2-5.el9.noarch.r 13 MB/s | 548 kB 00:00 2026-02-25T14:20:29.277 INFO:teuthology.orchestra.run.trial072.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-25T14:20:29.280 INFO:teuthology.orchestra.run.trial068.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-25T14:20:29.282 INFO:teuthology.orchestra.run.trial068.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-25T14:20:29.296 INFO:teuthology.orchestra.run.trial072.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 3.0 MB/s | 60 kB 00:00 2026-02-25T14:20:29.296 INFO:teuthology.orchestra.run.trial072.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.2 MB/s | 43 kB 00:00 2026-02-25T14:20:29.304 INFO:teuthology.orchestra.run.trial068.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-25T14:20:29.315 INFO:teuthology.orchestra.run.trial072.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-25T14:20:29.315 INFO:teuthology.orchestra.run.trial072.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 734 kB/s | 14 kB 00:00 2026-02-25T14:20:29.336 INFO:teuthology.orchestra.run.trial072.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 8.3 MB/s | 173 kB 00:00 2026-02-25T14:20:29.340 INFO:teuthology.orchestra.run.trial072.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 14 MB/s | 358 kB 00:00 2026-02-25T14:20:29.357 INFO:teuthology.orchestra.run.trial072.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 12 MB/s | 254 kB 00:00 2026-02-25T14:20:29.383 INFO:teuthology.orchestra.run.trial072.stdout:(69/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 47 MB/s | 2.0 MB 00:00 2026-02-25T14:20:29.384 INFO:teuthology.orchestra.run.trial072.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 5.3 MB/s | 144 kB 00:00 2026-02-25T14:20:29.404 INFO:teuthology.orchestra.run.trial072.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 6.6 MB/s | 139 kB 00:00 2026-02-25T14:20:29.404 INFO:teuthology.orchestra.run.trial072.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 2.7 MB/s | 56 kB 00:00 2026-02-25T14:20:29.423 INFO:teuthology.orchestra.run.trial072.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 565 kB/s | 11 kB 00:00 2026-02-25T14:20:29.424 INFO:teuthology.orchestra.run.trial072.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 929 kB/s | 18 kB 00:00 2026-02-25T14:20:29.443 INFO:teuthology.orchestra.run.trial072.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 1.2 MB/s | 23 kB 00:00 2026-02-25T14:20:29.458 INFO:teuthology.orchestra.run.trial072.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 1.0 MB/s | 20 kB 00:00 2026-02-25T14:20:29.462 INFO:teuthology.orchestra.run.trial072.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 1.0 MB/s | 19 kB 00:00 2026-02-25T14:20:29.462 INFO:teuthology.orchestra.run.trial072.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-25T14:20:29.486 INFO:teuthology.orchestra.run.trial072.stdout:(79/95): python3-kubernetes-26.1.0-3.el9.noarch 43 MB/s | 1.0 MB 00:00 2026-02-25T14:20:29.486 INFO:teuthology.orchestra.run.trial072.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 3.2 MB/s | 79 kB 00:00 2026-02-25T14:20:29.506 INFO:teuthology.orchestra.run.trial072.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.2 MB/s | 86 kB 00:00 2026-02-25T14:20:29.506 INFO:teuthology.orchestra.run.trial072.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-25T14:20:29.525 INFO:teuthology.orchestra.run.trial072.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 863 kB/s | 16 kB 00:00 2026-02-25T14:20:29.526 INFO:teuthology.orchestra.run.trial072.stdout:(84/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.6 MB/s | 90 kB 00:00 2026-02-25T14:20:29.545 INFO:teuthology.orchestra.run.trial072.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.6 MB/s | 31 kB 00:00 2026-02-25T14:20:29.546 INFO:teuthology.orchestra.run.trial072.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 9.3 MB/s | 188 kB 00:00 2026-02-25T14:20:29.563 INFO:teuthology.orchestra.run.trial072.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 3.0 MB/s | 59 kB 00:00 2026-02-25T14:20:29.566 INFO:teuthology.orchestra.run.trial072.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 6.0 MB/s | 125 kB 00:00 2026-02-25T14:20:29.583 INFO:teuthology.orchestra.run.trial072.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-25T14:20:29.585 INFO:teuthology.orchestra.run.trial072.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 4.4 MB/s | 86 kB 00:00 2026-02-25T14:20:29.603 INFO:teuthology.orchestra.run.trial072.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 4.5 MB/s | 90 kB 00:00 2026-02-25T14:20:29.605 INFO:teuthology.orchestra.run.trial072.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.4 MB/s | 48 kB 00:00 2026-02-25T14:20:29.622 INFO:teuthology.orchestra.run.trial072.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-25T14:20:29.624 INFO:teuthology.orchestra.run.trial072.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 1.0 MB/s | 20 kB 00:00 2026-02-25T14:20:29.630 INFO:teuthology.orchestra.run.trial068.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-25T14:20:29.706 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-25T14:20:29.711 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:29.711 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 1/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 3/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 4/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 5/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 6/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 7/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 8/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 9/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 10/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 11/95 2026-02-25T14:20:29.712 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 12/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 13/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 14/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 15/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-25T14:20:29.713 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-25T14:20:29.714 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/95 2026-02-25T14:20:29.715 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-25T14:20:29.716 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-25T14:20:29.717 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-25T14:20:29.718 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-25T14:20:29.719 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-25T14:20:29.719 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-25T14:20:29.719 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-25T14:20:29.719 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-25T14:20:29.719 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-25T14:20:29.777 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-25T14:20:29.777 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:29.778 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:29.778 INFO:teuthology.orchestra.run.trial031.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:20:29.778 INFO:teuthology.orchestra.run.trial031.stdout: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:29.778 INFO:teuthology.orchestra.run.trial031.stdout: ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.778 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.779 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.780 INFO:teuthology.orchestra.run.trial031.stdout: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:20:29.781 INFO:teuthology.orchestra.run.trial031.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:20:29.782 INFO:teuthology.orchestra.run.trial031.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:20:29.783 INFO:teuthology.orchestra.run.trial031.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:20:29.784 INFO:teuthology.orchestra.run.trial031.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:20:29.785 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:20:29.786 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:29.787 INFO:teuthology.orchestra.run.trial031.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:29.788 INFO:teuthology.orchestra.run.trial031.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:20:29.789 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:20:29.790 INFO:teuthology.orchestra.run.trial031.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:20:29.791 INFO:teuthology.orchestra.run.trial031.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:20:29.792 INFO:teuthology.orchestra.run.trial031.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:20:29.793 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T14:20:29.793 INFO:teuthology.orchestra.run.trial031.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T14:20:29.793 INFO:teuthology.orchestra.run.trial031.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:20:29.793 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:29.793 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:29.832 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-base 2026-02-25T14:20:29.835 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 4/5 2026-02-25T14:20:29.854 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:30.146 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:44 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:30.174 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 5/5 2026-02-25T14:20:30.174 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 1/5 2026-02-25T14:20:30.174 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2/5 2026-02-25T14:20:30.174 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T14:20:30.175 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T14:20:30.211 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:30.229 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:30.230 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:30.230 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:30.233 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T14:20:30.233 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:30.233 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:30.233 INFO:teuthology.orchestra.run.trial021.stdout: ceph-test-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout: libcephsqlite-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:30.234 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:30.250 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install cephadm 2026-02-25T14:20:30.268 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph 2026-02-25T14:20:30.342 INFO:teuthology.orchestra.run.trial072.stdout:(95/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 1.1 MB/s | 6.1 MB 00:05 2026-02-25T14:20:30.345 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:30.345 INFO:teuthology.orchestra.run.trial072.stdout:Total 4.8 MB/s | 101 MB 00:21 2026-02-25T14:20:30.372 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-25T14:20:30.388 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-25T14:20:30.398 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-25T14:20:30.405 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-25T14:20:30.418 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-25T14:20:30.434 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-25T14:20:30.509 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-25T14:20:30.517 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-25T14:20:30.541 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-25T14:20:30.566 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:44 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:30.570 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-25T14:20:30.585 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:42 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:30.621 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-25T14:20:30.627 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-25T14:20:30.630 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-25T14:20:30.631 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-25T14:20:30.632 INFO:teuthology.orchestra.run.trial031.stdout:Package cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:30.648 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:30.649 INFO:teuthology.orchestra.run.trial068.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:20:30.649 INFO:teuthology.orchestra.run.trial068.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:20:30.649 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:30.650 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:30.651 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:30.651 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:30.655 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:30.672 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:20:30.673 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:30.675 INFO:teuthology.orchestra.run.trial021.stdout:====================================================================================== 2026-02-25T14:20:30.675 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repository Size 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout:====================================================================================== 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 6.5 k 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout:Installing dependencies: 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-grafana-dashboards noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 43 k 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mds x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.3 M 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 961 k 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-modules-core noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 290 k 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mon x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 5.0 M 2026-02-25T14:20:30.676 INFO:teuthology.orchestra.run.trial021.stdout: ceph-osd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 17 M 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: ceph-prometheus-alerts noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 17 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 1.0 M 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-25T14:20:30.677 INFO:teuthology.orchestra.run.trial021.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T14:20:30.678 INFO:teuthology.orchestra.run.trial021.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T14:20:30.679 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-25T14:20:30.680 INFO:teuthology.orchestra.run.trial021.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T14:20:30.681 INFO:teuthology.orchestra.run.trial021.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-25T14:20:30.682 INFO:teuthology.orchestra.run.trial021.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout:Installing weak dependencies: 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-cephadm noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 173 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-dashboard noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 11 M 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 7.4 M 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 22 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-rook noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 50 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: ceph-volume noarch 2:20.2.0-676.gc824a7fa.el9 ceph-noarch 297 k 2026-02-25T14:20:30.683 INFO:teuthology.orchestra.run.trial021.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout:====================================================================================== 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout:Install 95 Packages 2026-02-25T14:20:30.684 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:30.685 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:30.685 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:20:30.685 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:30.685 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 101 M 2026-02-25T14:20:30.686 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 561 M 2026-02-25T14:20:30.686 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:30.716 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-25T14:20:30.759 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:30.778 INFO:teuthology.orchestra.run.trial068.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 80/95 2026-02-25T14:20:30.781 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:30.795 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:30.795 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:30.795 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:20:30.795 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:30.796 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:30.796 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:30.990 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:44 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 154 k 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:31.074 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 154 k 2026-02-25T14:20:31.075 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 447 k 2026-02-25T14:20:31.075 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:31.228 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:31.228 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:31.241 INFO:teuthology.orchestra.run.trial021.stdout:(1/95): ceph-20.2.0-676.gc824a7fa.el9.x86_64.rp 100 kB/s | 6.5 kB 00:00 2026-02-25T14:20:31.253 INFO:teuthology.orchestra.run.trial031.stdout:ceph-immutable-object-cache-20.2.0-676.gc824a7f 868 kB/s | 154 kB 00:00 2026-02-25T14:20:31.253 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:31.253 INFO:teuthology.orchestra.run.trial031.stdout:Total 863 kB/s | 154 kB 00:00 2026-02-25T14:20:31.254 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:31.258 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:31.258 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:31.290 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:31.291 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:31.336 INFO:teuthology.orchestra.run.trial021.stdout:(2/95): ceph-mgr-20.2.0-676.gc824a7fa.el9.x86_6 5.9 MB/s | 961 kB 00:00 2026-02-25T14:20:31.345 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:31.347 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:31.370 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:31.370 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:31.370 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:20:31.370 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:31.456 INFO:teuthology.orchestra.run.trial021.stdout:(3/95): ceph-mds-20.2.0-676.gc824a7fa.el9.x86_6 8.4 MB/s | 2.3 MB 00:00 2026-02-25T14:20:31.470 INFO:teuthology.orchestra.run.trial021.stdout:(4/95): ceph-grafana-dashboards-20.2.0-676.gc82 3.2 MB/s | 43 kB 00:00 2026-02-25T14:20:31.483 INFO:teuthology.orchestra.run.trial021.stdout:(5/95): ceph-mgr-cephadm-20.2.0-676.gc824a7fa.e 13 MB/s | 173 kB 00:00 2026-02-25T14:20:31.513 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:31.539 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:31.539 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:31.539 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:20:31.540 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:31.540 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:31.540 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:31.600 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:31.602 INFO:teuthology.orchestra.run.trial068.stdout: Installing : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:31.609 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 84/95 2026-02-25T14:20:31.632 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 85/95 2026-02-25T14:20:31.633 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:31.675 INFO:teuthology.orchestra.run.trial021.stdout:(6/95): ceph-mon-20.2.0-676.gc824a7fa.el9.x86_6 12 MB/s | 5.0 MB 00:00 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:31.686 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:31.691 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:31.694 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-25T14:20:31.697 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-25T14:20:31.714 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr 2026-02-25T14:20:31.719 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-25T14:20:31.752 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/95 2026-02-25T14:20:31.761 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-25T14:20:31.766 INFO:teuthology.orchestra.run.trial072.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-25T14:20:31.768 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-25T14:20:31.773 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-25T14:20:31.796 INFO:teuthology.orchestra.run.trial072.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-25T14:20:31.808 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-25T14:20:31.812 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-25T14:20:31.818 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-25T14:20:31.820 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-25T14:20:31.831 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-25T14:20:31.837 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-25T14:20:31.861 INFO:teuthology.orchestra.run.trial072.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-25T14:20:31.864 INFO:teuthology.orchestra.run.trial072.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-25T14:20:31.871 INFO:teuthology.orchestra.run.trial072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-25T14:20:31.911 INFO:teuthology.orchestra.run.trial021.stdout:(7/95): ceph-mgr-dashboard-20.2.0-676.gc824a7fa 25 MB/s | 11 MB 00:00 2026-02-25T14:20:31.921 INFO:teuthology.orchestra.run.trial072.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-25T14:20:31.923 INFO:teuthology.orchestra.run.trial021.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-676.gc824a7fa 1.8 MB/s | 22 kB 00:00 2026-02-25T14:20:31.934 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 20/95 2026-02-25T14:20:31.937 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-25T14:20:31.939 INFO:teuthology.orchestra.run.trial021.stdout:(9/95): ceph-mgr-modules-core-20.2.0-676.gc824a 18 MB/s | 290 kB 00:00 2026-02-25T14:20:31.941 INFO:teuthology.orchestra.run.trial072.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-25T14:20:31.947 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-25T14:20:31.951 INFO:teuthology.orchestra.run.trial021.stdout:(10/95): ceph-mgr-rook-20.2.0-676.gc824a7fa.el9 4.2 MB/s | 50 kB 00:00 2026-02-25T14:20:31.952 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-25T14:20:31.954 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-25T14:20:31.962 INFO:teuthology.orchestra.run.trial021.stdout:(11/95): ceph-prometheus-alerts-20.2.0-676.gc82 1.5 MB/s | 17 kB 00:00 2026-02-25T14:20:31.969 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-25T14:20:31.973 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-25T14:20:31.977 INFO:teuthology.orchestra.run.trial021.stdout:(12/95): ceph-volume-20.2.0-676.gc824a7fa.el9.n 19 MB/s | 297 kB 00:00 2026-02-25T14:20:31.978 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-25T14:20:31.989 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-25T14:20:31.998 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-25T14:20:32.004 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-25T14:20:32.020 INFO:teuthology.orchestra.run.trial021.stdout:(13/95): cephadm-20.2.0-676.gc824a7fa.el9.noarc 24 MB/s | 1.0 MB 00:00 2026-02-25T14:20:32.023 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-25T14:20:32.033 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:46 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:32.034 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-25T14:20:32.050 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-25T14:20:32.054 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-25T14:20:32.062 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-25T14:20:32.099 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:32.101 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-25T14:20:32.118 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:32.118 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:32.119 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:32.128 INFO:teuthology.orchestra.run.trial021.stdout:(14/95): cryptsetup-2.8.1-3.el9.x86_64.rpm 3.2 MB/s | 351 kB 00:00 2026-02-25T14:20:32.140 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:20:32.150 INFO:teuthology.orchestra.run.trial021.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.8 MB/s | 40 kB 00:00 2026-02-25T14:20:32.172 INFO:teuthology.orchestra.run.trial021.stdout:(16/95): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-25T14:20:32.230 INFO:teuthology.orchestra.run.trial021.stdout:(17/95): ceph-osd-20.2.0-676.gc824a7fa.el9.x86_ 19 MB/s | 17 MB 00:00 2026-02-25T14:20:32.231 INFO:teuthology.orchestra.run.trial021.stdout:(18/95): libgfortran-11.5.0-14.el9.x86_64.rpm 13 MB/s | 794 kB 00:00 2026-02-25T14:20:32.249 INFO:teuthology.orchestra.run.trial021.stdout:(19/95): ceph-mgr-diskprediction-local-20.2.0-6 13 MB/s | 7.4 MB 00:00 2026-02-25T14:20:32.258 INFO:teuthology.orchestra.run.trial021.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.2 MB/s | 253 kB 00:00 2026-02-25T14:20:32.282 INFO:teuthology.orchestra.run.trial021.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-25T14:20:32.306 INFO:teuthology.orchestra.run.trial021.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 5.5 MB/s | 135 kB 00:00 2026-02-25T14:20:32.314 INFO:teuthology.orchestra.run.trial021.stdout:(23/95): libquadmath-11.5.0-14.el9.x86_64.rpm 2.1 MB/s | 184 kB 00:00 2026-02-25T14:20:32.331 INFO:teuthology.orchestra.run.trial021.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 6.1 MB/s | 150 kB 00:00 2026-02-25T14:20:32.338 INFO:teuthology.orchestra.run.trial021.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 5.2 MB/s | 126 kB 00:00 2026-02-25T14:20:32.357 INFO:teuthology.orchestra.run.trial021.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 8.1 MB/s | 218 kB 00:00 2026-02-25T14:20:32.361 INFO:teuthology.orchestra.run.trial021.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-25T14:20:32.378 INFO:teuthology.orchestra.run.trial021.stdout:(28/95): python3-cryptography-36.0.1-5.el9.x86_ 9.7 MB/s | 1.2 MB 00:00 2026-02-25T14:20:32.381 INFO:teuthology.orchestra.run.trial021.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-25T14:20:32.424 INFO:teuthology.orchestra.run.trial021.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-9.el9. 352 kB/s | 15 kB 00:00 2026-02-25T14:20:32.424 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-25T14:20:32.425 INFO:teuthology.orchestra.run.trial021.stdout:(31/95): flexiblas-3.0.4-9.el9.x86_64.rpm 472 kB/s | 30 kB 00:00 2026-02-25T14:20:32.434 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-25T14:20:32.437 INFO:teuthology.orchestra.run.trial021.stdout:(32/95): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 51 MB/s | 3.0 MB 00:00 2026-02-25T14:20:32.438 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-25T14:20:32.443 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-25T14:20:32.445 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-25T14:20:32.452 INFO:teuthology.orchestra.run.trial021.stdout:(33/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 8.6 MB/s | 246 kB 00:00 2026-02-25T14:20:32.452 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:46 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:32.456 INFO:teuthology.orchestra.run.trial021.stdout:(34/95): lua-5.4.4-4.el9.x86_64.rpm 5.7 MB/s | 188 kB 00:00 2026-02-25T14:20:32.472 INFO:teuthology.orchestra.run.trial072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-25T14:20:32.490 INFO:teuthology.orchestra.run.trial021.stdout:(35/95): openblas-0.3.29-1.el9.x86_64.rpm 792 kB/s | 42 kB 00:00 2026-02-25T14:20:32.496 INFO:teuthology.orchestra.run.trial021.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 25 MB/s | 1.0 MB 00:00 2026-02-25T14:20:32.516 INFO:teuthology.orchestra.run.trial072.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-25T14:20:32.517 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:32.522 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-25T14:20:32.526 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-25T14:20:32.531 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-25T14:20:32.535 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-25T14:20:32.536 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:32.536 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:32.537 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:32.542 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-25T14:20:32.545 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-25T14:20:32.547 INFO:teuthology.orchestra.run.trial021.stdout:(37/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 56 MB/s | 5.3 MB 00:00 2026-02-25T14:20:32.558 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:20:32.558 INFO:teuthology.orchestra.run.trial021.stdout:(38/95): python3-devel-3.9.25-3.el9.x86_64.rpm 3.9 MB/s | 244 kB 00:00 2026-02-25T14:20:32.573 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-25T14:20:32.574 INFO:teuthology.orchestra.run.trial021.stdout:(39/95): python3-babel-2.9.1-2.el9.noarch.rpm 71 MB/s | 6.0 MB 00:00 2026-02-25T14:20:32.578 INFO:teuthology.orchestra.run.trial021.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.1 MB/s | 249 kB 00:00 2026-02-25T14:20:32.582 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-25T14:20:32.587 INFO:teuthology.orchestra.run.trial021.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 1.6 MB/s | 48 kB 00:00 2026-02-25T14:20:32.588 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-25T14:20:32.595 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-25T14:20:32.608 INFO:teuthology.orchestra.run.trial021.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 5.2 MB/s | 177 kB 00:00 2026-02-25T14:20:32.617 INFO:teuthology.orchestra.run.trial021.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.1 MB/s | 35 kB 00:00 2026-02-25T14:20:32.625 INFO:teuthology.orchestra.run.trial021.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 26 MB/s | 1.2 MB 00:00 2026-02-25T14:20:32.629 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-25T14:20:32.648 INFO:teuthology.orchestra.run.trial021.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 14 MB/s | 442 kB 00:00 2026-02-25T14:20:32.655 INFO:teuthology.orchestra.run.trial021.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 2.5 MB/s | 77 kB 00:00 2026-02-25T14:20:32.686 INFO:teuthology.orchestra.run.trial021.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 6.9 MB/s | 267 kB 00:00 2026-02-25T14:20:32.689 INFO:teuthology.orchestra.run.trial021.stdout:(48/95): python3-pyasn1-0.4.8-7.el9.noarch.rpm 4.6 MB/s | 157 kB 00:00 2026-02-25T14:20:32.702 INFO:teuthology.orchestra.run.trial021.stdout:(49/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 65 MB/s | 6.1 MB 00:00 2026-02-25T14:20:32.716 INFO:teuthology.orchestra.run.trial021.stdout:(50/95): python3-pyasn1-modules-0.4.8-7.el9.noa 9.2 MB/s | 277 kB 00:00 2026-02-25T14:20:32.720 INFO:teuthology.orchestra.run.trial021.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 1.7 MB/s | 54 kB 00:00 2026-02-25T14:20:32.747 INFO:teuthology.orchestra.run.trial021.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.3 MB/s | 42 kB 00:00 2026-02-25T14:20:32.756 INFO:teuthology.orchestra.run.trial021.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 5.2 MB/s | 189 kB 00:00 2026-02-25T14:20:32.774 INFO:teuthology.orchestra.run.trial021.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.3 MB/s | 90 kB 00:00 2026-02-25T14:20:32.789 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:32.794 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:32.822 INFO:teuthology.orchestra.run.trial021.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 340 kB/s | 22 kB 00:00 2026-02-25T14:20:32.851 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 56/95 2026-02-25T14:20:32.868 INFO:teuthology.orchestra.run.trial021.stdout:(56/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 116 MB/s | 19 MB 00:00 2026-02-25T14:20:32.873 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:46 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:32.874 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-25T14:20:32.878 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-25T14:20:32.927 INFO:teuthology.orchestra.run.trial021.stdout:(57/95): protobuf-compiler-3.14.0-17.el9.x86_64 5.5 MB/s | 862 kB 00:00 2026-02-25T14:20:32.936 INFO:teuthology.orchestra.run.trial072.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-25T14:20:32.938 INFO:teuthology.orchestra.run.trial072.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-25T14:20:32.938 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:32.957 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:32.957 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:32.958 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:32.959 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-25T14:20:32.979 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:20:32.981 INFO:teuthology.orchestra.run.trial021.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 176 kB/s | 19 kB 00:00 2026-02-25T14:20:33.069 INFO:teuthology.orchestra.run.trial021.stdout:(59/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.2 MB/s | 551 kB 00:00 2026-02-25T14:20:33.080 INFO:teuthology.orchestra.run.trial021.stdout:(60/95): luarocks-3.9.2-5.el9.noarch.rpm 993 kB/s | 151 kB 00:00 2026-02-25T14:20:33.096 INFO:teuthology.orchestra.run.trial021.stdout:(61/95): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-25T14:20:33.109 INFO:teuthology.orchestra.run.trial021.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 2.1 MB/s | 60 kB 00:00 2026-02-25T14:20:33.117 INFO:teuthology.orchestra.run.trial021.stdout:(63/95): python3-asyncssh-2.13.2-5.el9.noarch.r 3.9 MB/s | 548 kB 00:00 2026-02-25T14:20:33.123 INFO:teuthology.orchestra.run.trial021.stdout:(64/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-25T14:20:33.134 INFO:teuthology.orchestra.run.trial021.stdout:(65/95): python3-cachetools-4.2.4-1.el9.noarch. 1.2 MB/s | 32 kB 00:00 2026-02-25T14:20:33.143 INFO:teuthology.orchestra.run.trial021.stdout:(66/95): python3-certifi-2023.05.07-4.el9.noarc 536 kB/s | 14 kB 00:00 2026-02-25T14:20:33.155 INFO:teuthology.orchestra.run.trial021.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 5.3 MB/s | 173 kB 00:00 2026-02-25T14:20:33.177 INFO:teuthology.orchestra.run.trial021.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 7.4 MB/s | 254 kB 00:00 2026-02-25T14:20:33.193 INFO:teuthology.orchestra.run.trial021.stdout:(69/95): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2026-02-25T14:20:33.212 INFO:teuthology.orchestra.run.trial021.stdout:(70/95): python3-grpcio-tools-1.46.7-10.el9.x86 4.0 MB/s | 144 kB 00:00 2026-02-25T14:20:33.221 INFO:teuthology.orchestra.run.trial021.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 4.9 MB/s | 139 kB 00:00 2026-02-25T14:20:33.240 INFO:teuthology.orchestra.run.trial021.stdout:(72/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 24 MB/s | 2.0 MB 00:00 2026-02-25T14:20:33.241 INFO:teuthology.orchestra.run.trial021.stdout:(73/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.9 MB/s | 56 kB 00:00 2026-02-25T14:20:33.244 INFO:teuthology.orchestra.run.trial021.stdout:(74/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 469 kB/s | 11 kB 00:00 2026-02-25T14:20:33.267 INFO:teuthology.orchestra.run.trial021.stdout:(75/95): python3-jaraco-context-6.0.1-3.el9.noa 855 kB/s | 20 kB 00:00 2026-02-25T14:20:33.268 INFO:teuthology.orchestra.run.trial021.stdout:(76/95): python3-jaraco-classes-3.2.1-5.el9.noa 660 kB/s | 18 kB 00:00 2026-02-25T14:20:33.268 INFO:teuthology.orchestra.run.trial021.stdout:(77/95): python3-jaraco-collections-3.0.0-8.el9 870 kB/s | 23 kB 00:00 2026-02-25T14:20:33.269 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:33.270 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:33.282 INFO:teuthology.orchestra.run.trial072.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-25T14:20:33.283 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:33.283 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:33.290 INFO:teuthology.orchestra.run.trial021.stdout:(78/95): python3-jaraco-functools-3.5.0-2.el9.n 834 kB/s | 19 kB 00:00 2026-02-25T14:20:33.294 INFO:teuthology.orchestra.run.trial021.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 982 kB/s | 26 kB 00:00 2026-02-25T14:20:33.296 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:47 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:33.316 INFO:teuthology.orchestra.run.trial021.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 3.0 MB/s | 79 kB 00:00 2026-02-25T14:20:33.322 INFO:teuthology.orchestra.run.trial021.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2026-02-25T14:20:33.327 INFO:teuthology.orchestra.run.trial021.stdout:(82/95): python3-kubernetes-26.1.0-3.el9.noarch 17 MB/s | 1.0 MB 00:00 2026-02-25T14:20:33.339 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:33.340 INFO:teuthology.orchestra.run.trial021.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2026-02-25T14:20:33.349 INFO:teuthology.orchestra.run.trial021.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 616 kB/s | 16 kB 00:00 2026-02-25T14:20:33.354 INFO:teuthology.orchestra.run.trial021.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.3 MB/s | 90 kB 00:00 2026-02-25T14:20:33.355 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-25T14:20:33.363 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:33.364 INFO:teuthology.orchestra.run.trial021.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.3 MB/s | 31 kB 00:00 2026-02-25T14:20:33.377 INFO:teuthology.orchestra.run.trial021.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 6.6 MB/s | 188 kB 00:00 2026-02-25T14:20:33.381 INFO:teuthology.orchestra.run.trial021.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2026-02-25T14:20:33.381 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:33.382 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:33.382 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:33.385 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 90/95 2026-02-25T14:20:33.386 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:33.391 INFO:teuthology.orchestra.run.trial021.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 4.6 MB/s | 125 kB 00:00 2026-02-25T14:20:33.404 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:20:33.405 INFO:teuthology.orchestra.run.trial021.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.3 MB/s | 36 kB 00:00 2026-02-25T14:20:33.407 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:33.407 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:33.408 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:20:33.408 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:33.408 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:33.408 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:33.408 INFO:teuthology.orchestra.run.trial021.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 3.1 MB/s | 86 kB 00:00 2026-02-25T14:20:33.417 INFO:teuthology.orchestra.run.trial021.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 3.4 MB/s | 90 kB 00:00 2026-02-25T14:20:33.418 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:33.432 INFO:teuthology.orchestra.run.trial021.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.7 MB/s | 48 kB 00:00 2026-02-25T14:20:33.435 INFO:teuthology.orchestra.run.trial021.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 823 kB/s | 22 kB 00:00 2026-02-25T14:20:33.441 INFO:teuthology.orchestra.run.trial021.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 838 kB/s | 20 kB 00:00 2026-02-25T14:20:33.444 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:33.444 INFO:teuthology.orchestra.run.trial021.stdout:Total 37 MB/s | 101 MB 00:02 2026-02-25T14:20:33.651 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:33.653 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:33.674 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:33.674 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:33.674 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:20:33.675 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:33.675 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:33.675 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:33.720 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:47 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:33.778 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:33.785 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:33.797 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:33.798 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:33.798 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:20:33.798 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:33.798 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:33.798 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:33.803 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:33.804 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:33.804 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:33.817 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:33.825 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-fuse 2026-02-25T14:20:33.883 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:33.920 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:33.920 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:34.022 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-25T14:20:34.039 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-25T14:20:34.049 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-25T14:20:34.055 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-25T14:20:34.069 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-25T14:20:34.084 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-25T14:20:34.139 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:48 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:34.159 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-25T14:20:34.167 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-25T14:20:34.191 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-25T14:20:34.220 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 942 k 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 942 k 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 2.7 M 2026-02-25T14:20:34.223 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:34.270 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-25T14:20:34.276 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-25T14:20:34.280 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-25T14:20:34.282 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-25T14:20:34.300 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:34.300 INFO:teuthology.orchestra.run.trial072.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:20:34.300 INFO:teuthology.orchestra.run.trial072.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:20:34.300 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:34.310 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:34.336 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:34.336 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:20:34.336 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:34.352 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:34.352 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:34.371 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-25T14:20:34.383 INFO:teuthology.orchestra.run.trial031.stdout:ceph-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 5.8 MB/s | 942 kB 00:00 2026-02-25T14:20:34.385 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:34.385 INFO:teuthology.orchestra.run.trial031.stdout:Total 5.7 MB/s | 942 kB 00:00 2026-02-25T14:20:34.385 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:34.390 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:34.391 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:34.424 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:34.424 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:34.433 INFO:teuthology.orchestra.run.trial072.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 80/95 2026-02-25T14:20:34.435 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:34.448 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:34.448 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:34.449 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:20:34.449 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:34.515 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:34.531 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:34.531 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 1/95 2026-02-25T14:20:34.531 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2/95 2026-02-25T14:20:34.531 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 3/95 2026-02-25T14:20:34.531 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 4/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 5/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 6/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 7/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 8/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 9/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 10/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 11/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 12/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 13/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 14/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 15/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/95 2026-02-25T14:20:34.532 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-25T14:20:34.533 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-25T14:20:34.534 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-25T14:20:34.535 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-25T14:20:34.536 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-25T14:20:34.537 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-25T14:20:34.538 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:34.598 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-25T14:20:34.598 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:34.598 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.599 INFO:teuthology.orchestra.run.trial068.stdout: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:20:34.600 INFO:teuthology.orchestra.run.trial068.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:20:34.601 INFO:teuthology.orchestra.run.trial068.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:20:34.602 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:20:34.603 INFO:teuthology.orchestra.run.trial068.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:20:34.603 INFO:teuthology.orchestra.run.trial068.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:20:34.603 INFO:teuthology.orchestra.run.trial068.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:20:34.603 INFO:teuthology.orchestra.run.trial068.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:34.603 INFO:teuthology.orchestra.run.trial068.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:20:34.604 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:20:34.605 INFO:teuthology.orchestra.run.trial068.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:20:34.605 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:20:34.605 INFO:teuthology.orchestra.run.trial068.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:20:34.605 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:20:34.605 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:20:34.606 INFO:teuthology.orchestra.run.trial068.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T14:20:34.607 INFO:teuthology.orchestra.run.trial068.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T14:20:34.608 INFO:teuthology.orchestra.run.trial068.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:20:34.608 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:34.608 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:34.654 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-base 2026-02-25T14:20:34.756 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:34.819 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:34.819 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:34.819 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:34.820 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:34.820 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:34.820 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:34.829 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:34.831 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-25T14:20:34.835 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-25T14:20:34.848 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-volume 2026-02-25T14:20:34.856 INFO:teuthology.orchestra.run.trial021.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-25T14:20:34.890 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 4/95 2026-02-25T14:20:34.899 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-25T14:20:34.905 INFO:teuthology.orchestra.run.trial021.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-25T14:20:34.907 INFO:teuthology.orchestra.run.trial021.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-25T14:20:34.911 INFO:teuthology.orchestra.run.trial021.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 8/95 2026-02-25T14:20:34.935 INFO:teuthology.orchestra.run.trial021.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-25T14:20:34.947 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-25T14:20:34.951 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-25T14:20:34.956 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-25T14:20:34.958 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-25T14:20:34.969 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-25T14:20:34.975 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-25T14:20:34.981 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:46 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:35.000 INFO:teuthology.orchestra.run.trial021.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-25T14:20:35.003 INFO:teuthology.orchestra.run.trial021.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-25T14:20:35.010 INFO:teuthology.orchestra.run.trial021.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-25T14:20:35.047 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:35.062 INFO:teuthology.orchestra.run.trial021.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-25T14:20:35.065 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:35.066 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:35.066 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:35.075 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 20/95 2026-02-25T14:20:35.077 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-25T14:20:35.082 INFO:teuthology.orchestra.run.trial021.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-25T14:20:35.087 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install cephadm 2026-02-25T14:20:35.088 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-25T14:20:35.092 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-25T14:20:35.095 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-25T14:20:35.110 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-25T14:20:35.114 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-25T14:20:35.119 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:35.119 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-25T14:20:35.131 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-25T14:20:35.140 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-25T14:20:35.143 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:35.143 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:35.143 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:20:35.143 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:35.143 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:35.144 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:35.146 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-25T14:20:35.166 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-25T14:20:35.167 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:49 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:35.177 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-25T14:20:35.193 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-25T14:20:35.197 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-25T14:20:35.200 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:35.202 INFO:teuthology.orchestra.run.trial072.stdout: Installing : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:35.205 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-25T14:20:35.209 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 84/95 2026-02-25T14:20:35.232 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 85/95 2026-02-25T14:20:35.233 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:35.233 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:35.246 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-25T14:20:35.252 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:35.252 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:35.252 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:35.275 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados-devel 2026-02-25T14:20:35.407 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:47 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:35.472 INFO:teuthology.orchestra.run.trial068.stdout:Package cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:35.490 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:35.491 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:35.491 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:35.512 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:20:35.574 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-25T14:20:35.584 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-25T14:20:35.588 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-25T14:20:35.593 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-25T14:20:35.594 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:49 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:35.595 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-25T14:20:35.623 INFO:teuthology.orchestra.run.trial021.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-25T14:20:35.667 INFO:teuthology.orchestra.run.trial021.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-25T14:20:35.673 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-25T14:20:35.677 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-25T14:20:35.679 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 126 k 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:35.680 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 126 k 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 449 k 2026-02-25T14:20:35.681 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:35.683 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-25T14:20:35.686 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-25T14:20:35.693 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-25T14:20:35.697 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-25T14:20:35.725 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-25T14:20:35.734 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-25T14:20:35.740 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-25T14:20:35.747 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-25T14:20:35.782 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-25T14:20:35.829 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:47 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:35.914 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 154 k 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 154 k 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 447 k 2026-02-25T14:20:35.915 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:36.008 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 56/95 2026-02-25T14:20:36.025 INFO:teuthology.orchestra.run.trial031.stdout:librados-devel-20.2.0-676.gc824a7fa.el9.x86_64. 364 kB/s | 126 kB 00:00 2026-02-25T14:20:36.026 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:36.026 INFO:teuthology.orchestra.run.trial031.stdout:Total 363 kB/s | 126 kB 00:00 2026-02-25T14:20:36.026 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:36.029 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:36.029 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:36.032 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-25T14:20:36.035 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-25T14:20:36.062 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:36.062 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:36.094 INFO:teuthology.orchestra.run.trial021.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-25T14:20:36.096 INFO:teuthology.orchestra.run.trial021.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-25T14:20:36.117 INFO:teuthology.orchestra.run.trial021.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 61/95 2026-02-25T14:20:36.118 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:36.134 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:36.223 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:36.286 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:36.286 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:36.286 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:36.286 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:36.286 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:36.287 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:36.313 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install libcephfs2 2026-02-25T14:20:36.374 INFO:teuthology.orchestra.run.trial068.stdout:ceph-immutable-object-cache-20.2.0-676.gc824a7f 335 kB/s | 154 kB 00:00 2026-02-25T14:20:36.374 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:36.376 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:36.376 INFO:teuthology.orchestra.run.trial068.stdout:Total 333 kB/s | 154 kB 00:00 2026-02-25T14:20:36.376 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:36.379 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:36.381 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:36.381 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:36.413 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:36.413 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:36.445 INFO:teuthology.orchestra.run.trial021.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 62/95 2026-02-25T14:20:36.468 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:36.470 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:36.492 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:36.493 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:36.493 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:20:36.493 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:36.523 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-25T14:20:36.627 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:50 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:36.692 INFO:teuthology.orchestra.run.trial031.stdout:Package libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:36.710 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:36.712 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:36.712 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:36.733 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install libcephfs-devel 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:36.817 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:36.835 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:36.836 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:36.844 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr 2026-02-25T14:20:36.849 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:36.849 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:36.906 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:36.950 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 90/95 2026-02-25T14:20:36.951 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:36.973 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:36.984 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:37.049 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:51 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 34 k 2026-02-25T14:20:37.134 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 34 k 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 155 k 2026-02-25T14:20:37.135 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:37.158 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:49 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:37.200 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-25T14:20:37.207 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:37.209 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:37.217 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-25T14:20:37.224 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:37.227 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:37.231 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:37.234 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-25T14:20:37.243 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:37.243 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:37.244 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:37.247 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-25T14:20:37.263 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-25T14:20:37.265 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:20:37.329 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:37.339 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-25T14:20:37.348 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:37.349 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:37.368 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:37.372 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-25T14:20:37.402 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-25T14:20:37.408 INFO:teuthology.orchestra.run.trial031.stdout:libcephfs-devel-20.2.0-676.gc824a7fa.el9.x86_64 125 kB/s | 34 kB 00:00 2026-02-25T14:20:37.409 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:37.409 INFO:teuthology.orchestra.run.trial031.stdout:Total 125 kB/s | 34 kB 00:00 2026-02-25T14:20:37.409 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:37.411 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:37.411 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:37.414 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:37.414 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:37.436 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:37.453 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-25T14:20:37.454 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:37.459 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-25T14:20:37.462 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-25T14:20:37.463 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-25T14:20:37.482 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:37.482 INFO:teuthology.orchestra.run.trial021.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-25T14:20:37.482 INFO:teuthology.orchestra.run.trial021.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-25T14:20:37.482 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:37.491 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:37.515 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:37.517 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-25T14:20:37.517 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T14:20:37.517 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:37.552 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-25T14:20:37.578 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:37.578 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:37.579 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:37.579 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:37.579 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:37.579 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:37.579 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:49 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:37.606 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados2 2026-02-25T14:20:37.615 INFO:teuthology.orchestra.run.trial021.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 80/95 2026-02-25T14:20:37.617 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:37.631 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 81/95 2026-02-25T14:20:37.631 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:37.631 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-25T14:20:37.632 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:37.645 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:37.663 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:37.664 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:37.664 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:37.685 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:20:37.917 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:51 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:37.983 INFO:teuthology.orchestra.run.trial031.stdout:Package librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:38.002 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:38.002 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:38.002 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:38.003 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:50 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:38.023 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librbd1 2026-02-25T14:20:38.067 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:38.086 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:38.087 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:38.087 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:38.093 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 1/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 3/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 4/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 5/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 6/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 7/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 8/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 9/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 10/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 11/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 12/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 13/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 14/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 15/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-25T14:20:38.094 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-25T14:20:38.095 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-25T14:20:38.096 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-25T14:20:38.097 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-25T14:20:38.108 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:20:38.166 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-25T14:20:38.166 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.167 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:20:38.168 INFO:teuthology.orchestra.run.trial072.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:20:38.169 INFO:teuthology.orchestra.run.trial072.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:20:38.170 INFO:teuthology.orchestra.run.trial072.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:20:38.171 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:38.172 INFO:teuthology.orchestra.run.trial072.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:20:38.173 INFO:teuthology.orchestra.run.trial072.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:20:38.174 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T14:20:38.175 INFO:teuthology.orchestra.run.trial072.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T14:20:38.175 INFO:teuthology.orchestra.run.trial072.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:20:38.175 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:38.175 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:38.220 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-base 2026-02-25T14:20:38.309 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:38.334 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 82/95 2026-02-25T14:20:38.335 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:38.335 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T14:20:38.335 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:38.335 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T14:20:38.335 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:38.337 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:38.395 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:38.397 INFO:teuthology.orchestra.run.trial021.stdout: Installing : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 83/95 2026-02-25T14:20:38.402 INFO:teuthology.orchestra.run.trial031.stdout:Package librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:38.404 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 84/95 2026-02-25T14:20:38.421 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:38.421 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:38.422 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:38.426 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:50 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:38.427 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 85/95 2026-02-25T14:20:38.429 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:38.443 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rados 2026-02-25T14:20:38.493 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:38.511 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:38.513 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:38.513 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:38.532 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:20:38.535 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:38.601 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:38.619 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:38.620 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:38.620 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:38.642 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install cephadm 2026-02-25T14:20:38.765 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:38.830 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:38.848 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:38.849 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:38.849 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:38.854 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:50 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:38.870 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rgw 2026-02-25T14:20:38.920 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:38.939 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:38.940 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:38.940 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:38.954 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:38.961 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-fuse 2026-02-25T14:20:39.019 INFO:teuthology.orchestra.run.trial072.stdout:Package cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:39.038 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:39.038 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:39.039 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:39.059 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:20:39.187 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:53 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:39.253 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:39.271 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:39.272 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:39.272 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:39.275 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:51 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:39.294 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-cephfs 2026-02-25T14:20:39.359 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 942 k 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:39.360 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:39.361 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 942 k 2026-02-25T14:20:39.361 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 2.7 M 2026-02-25T14:20:39.361 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:39.375 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:55 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:39.459 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 154 k 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:39.460 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:39.461 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:39.461 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:39.461 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 154 k 2026-02-25T14:20:39.461 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 447 k 2026-02-25T14:20:39.461 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:39.581 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 86/95 2026-02-25T14:20:39.587 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:39.610 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:53 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:39.676 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:39.694 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:39.695 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:39.695 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:39.716 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rbd 2026-02-25T14:20:39.864 INFO:teuthology.orchestra.run.trial072.stdout:ceph-immutable-object-cache-20.2.0-676.gc824a7f 381 kB/s | 154 kB 00:00 2026-02-25T14:20:39.865 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:39.865 INFO:teuthology.orchestra.run.trial072.stdout:Total 380 kB/s | 154 kB 00:00 2026-02-25T14:20:39.865 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:39.869 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:39.869 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:39.900 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:39.900 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:39.951 INFO:teuthology.orchestra.run.trial068.stdout:ceph-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 1.6 MB/s | 942 kB 00:00 2026-02-25T14:20:39.951 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:39.951 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.6 MB/s | 942 kB 00:00 2026-02-25T14:20:39.952 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:39.955 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:39.957 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:39.957 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:39.957 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:39.981 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:39.981 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:39.981 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:20:39.981 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:39.990 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:39.990 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:40.033 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:40.042 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 87/95 2026-02-25T14:20:40.043 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:40.057 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 88/95 2026-02-25T14:20:40.058 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:40.081 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:40.099 INFO:teuthology.orchestra.run.trial031.stdout:Package python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:40.099 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:40.116 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 89/95 2026-02-25T14:20:40.117 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:40.118 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:20:40.118 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:40.139 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-fuse 2026-02-25T14:20:40.160 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 90/95 2026-02-25T14:20:40.161 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:40.184 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 91/95 2026-02-25T14:20:40.184 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:40.184 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T14:20:40.184 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:40.185 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T14:20:40.185 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:40.195 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:40.273 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:40.300 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr 2026-02-25T14:20:40.306 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:40.369 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:40.396 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-volume 2026-02-25T14:20:40.420 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 92/95 2026-02-25T14:20:40.422 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:40.442 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 93/95 2026-02-25T14:20:40.443 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:40.443 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T14:20:40.443 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:40.443 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T14:20:40.443 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:40.452 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:40.536 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 91 k 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:40.537 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:40.538 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:40.538 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:40.538 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 91 k 2026-02-25T14:20:40.538 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 238 k 2026-02-25T14:20:40.538 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:40.540 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:40.560 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 94/95 2026-02-25T14:20:40.561 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:40.561 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T14:20:40.561 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:40.561 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T14:20:40.561 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:40.580 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:40.615 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:40.681 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:40.699 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:40.700 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:40.700 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:40.717 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:52 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:40.721 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:20:40.783 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:40.802 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:40.803 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:40.803 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:40.824 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados-devel 2026-02-25T14:20:40.924 INFO:teuthology.orchestra.run.trial031.stdout:rbd-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 235 kB/s | 91 kB 00:00 2026-02-25T14:20:40.924 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:40.924 INFO:teuthology.orchestra.run.trial031.stdout:Total 235 kB/s | 91 kB 00:00 2026-02-25T14:20:40.924 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:40.929 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:40.929 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:40.960 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:40.960 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:41.012 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:41.029 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:41.036 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:41.103 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:41.116 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:41.121 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:41.122 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:41.122 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:41.139 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:53 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:41.143 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:20:41.179 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:41.180 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:41.180 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:41.180 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.180 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:41.180 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:41.208 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-mirror 2026-02-25T14:20:41.224 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:41.225 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:41.225 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 126 k 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 126 k 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 449 k 2026-02-25T14:20:41.226 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 95/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 1/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 3/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 4/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 5/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9 6/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 7/95 2026-02-25T14:20:41.318 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noar 8/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7 9/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noar 10/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.n 11/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 12/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9. 13/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 14/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 15/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 16/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-25T14:20:41.319 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/95 2026-02-25T14:20:41.320 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 39/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-25T14:20:41.321 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 49/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 50/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-25T14:20:41.322 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-25T14:20:41.323 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-25T14:20:41.324 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-25T14:20:41.325 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-25T14:20:41.385 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-grafana-dashboards-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mds-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.386 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-k8sevents-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-modules-core-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mon-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-osd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-prometheus-alerts-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: cephadm-2:20.2.0-676.gc824a7fa.el9.noarch 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-25T14:20:41.387 INFO:teuthology.orchestra.run.trial021.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: lua-5.4.4-4.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-25T14:20:41.388 INFO:teuthology.orchestra.run.trial021.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-25T14:20:41.389 INFO:teuthology.orchestra.run.trial021.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-25T14:20:41.390 INFO:teuthology.orchestra.run.trial021.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-25T14:20:41.391 INFO:teuthology.orchestra.run.trial021.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T14:20:41.392 INFO:teuthology.orchestra.run.trial021.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T14:20:41.393 INFO:teuthology.orchestra.run.trial021.stdout: unzip-6.0-59.el9.x86_64 2026-02-25T14:20:41.394 INFO:teuthology.orchestra.run.trial021.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-25T14:20:41.394 INFO:teuthology.orchestra.run.trial021.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-25T14:20:41.394 INFO:teuthology.orchestra.run.trial021.stdout: zip-3.0-35.el9.x86_64 2026-02-25T14:20:41.394 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:41.394 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:41.443 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-base 2026-02-25T14:20:41.456 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:41.521 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:41.528 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:55 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:41.540 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:41.540 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:41.541 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:41.561 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.9 M 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:41.612 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:41.613 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:41.613 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:41.613 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 2.9 M 2026-02-25T14:20:41.613 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 11 M 2026-02-25T14:20:41.613 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:41.743 INFO:teuthology.orchestra.run.trial068.stdout:librados-devel-20.2.0-676.gc824a7fa.el9.x86_64. 243 kB/s | 126 kB 00:00 2026-02-25T14:20:41.743 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:41.743 INFO:teuthology.orchestra.run.trial068.stdout:Total 243 kB/s | 126 kB 00:00 2026-02-25T14:20:41.744 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:41.746 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:41.746 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:41.771 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:53 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:41.779 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:41.779 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:41.835 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:41.836 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-base-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:41.853 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:41.855 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:41.855 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:41.855 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:41.877 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install cephadm 2026-02-25T14:20:41.880 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:41.941 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:41.944 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:41.963 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:41.963 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:41.963 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:41.985 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:20:42.003 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:42.003 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:42.004 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:42.004 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:42.004 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:42.004 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:42.032 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install libcephfs2 2026-02-25T14:20:42.195 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:42.260 INFO:teuthology.orchestra.run.trial021.stdout:Package cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:42.278 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:42.279 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:42.279 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:42.300 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T14:20:42.306 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:58 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:42.316 INFO:teuthology.orchestra.run.trial031.stdout:rbd-mirror-20.2.0-676.gc824a7fa.el9.x86_64.rpm 4.1 MB/s | 2.9 MB 00:00 2026-02-25T14:20:42.316 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:42.317 INFO:teuthology.orchestra.run.trial031.stdout:Total 4.1 MB/s | 2.9 MB 00:00 2026-02-25T14:20:42.317 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:42.321 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:42.322 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:42.356 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:42.361 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:42.361 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:42.372 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:42.391 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:42.392 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:42.392 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:42.414 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-fuse 2026-02-25T14:20:42.422 INFO:teuthology.orchestra.run.trial068.stdout:Package libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:42.441 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:42.442 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:42.442 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:42.463 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install libcephfs-devel 2026-02-25T14:20:42.548 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:42.549 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:42.573 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:42.620 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 154 k 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:42.705 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 154 k 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 447 k 2026-02-25T14:20:42.706 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:42.732 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:00:58 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:42.777 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:42.816 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:42.817 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:42.817 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:42.817 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:42.817 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:42.817 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 942 k 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 942 k 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 2.7 M 2026-02-25T14:20:42.818 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:42.861 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 34 k 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 34 k 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 155 k 2026-02-25T14:20:42.862 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:42.882 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:42.910 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-nbd 2026-02-25T14:20:43.083 INFO:teuthology.orchestra.run.trial021.stdout:ceph-immutable-object-cache-20.2.0-676.gc824a7f 408 kB/s | 154 kB 00:00 2026-02-25T14:20:43.083 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:43.083 INFO:teuthology.orchestra.run.trial021.stdout:Total 407 kB/s | 154 kB 00:00 2026-02-25T14:20:43.083 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:43.088 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:43.088 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:43.120 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:43.120 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:43.121 INFO:teuthology.orchestra.run.trial068.stdout:libcephfs-devel-20.2.0-676.gc824a7fa.el9.x86_64 133 kB/s | 34 kB 00:00 2026-02-25T14:20:43.121 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:43.121 INFO:teuthology.orchestra.run.trial068.stdout:Total 132 kB/s | 34 kB 00:00 2026-02-25T14:20:43.121 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:43.124 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:43.124 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:43.126 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:43.127 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:43.149 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:43.167 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.179 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:43.180 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:43.202 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:43.203 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:43.203 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T14:20:43.203 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:43.227 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.234 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:43.279 INFO:teuthology.orchestra.run.trial072.stdout:ceph-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 2.0 MB/s | 942 kB 00:00 2026-02-25T14:20:43.279 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:43.279 INFO:teuthology.orchestra.run.trial072.stdout:Total 2.0 MB/s | 942 kB 00:00 2026-02-25T14:20:43.279 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:43.284 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:43.284 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:43.288 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.288 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:43.289 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:43.289 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:43.289 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:43.289 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:43.317 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados2 2026-02-25T14:20:43.318 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:43.318 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:43.319 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 180 k 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:43.320 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:43.321 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 180 k 2026-02-25T14:20:43.321 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 498 k 2026-02-25T14:20:43.321 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:43.408 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:43.426 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.528 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.e 1/1 2026-02-25T14:20:43.528 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:43.528 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:43.528 INFO:teuthology.orchestra.run.trial021.stdout: ceph-immutable-object-cache-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:43.528 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:43.529 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:43.557 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr 2026-02-25T14:20:43.601 INFO:teuthology.orchestra.run.trial031.stdout:rbd-nbd-20.2.0-676.gc824a7fa.el9.x86_64.rpm 637 kB/s | 180 kB 00:00 2026-02-25T14:20:43.602 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:43.602 INFO:teuthology.orchestra.run.trial031.stdout:Total 636 kB/s | 180 kB 00:00 2026-02-25T14:20:43.602 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:43.606 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:43.607 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:43.638 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:43.638 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:43.640 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:55 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:43.655 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.695 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:43.707 INFO:teuthology.orchestra.run.trial068.stdout:Package librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:43.712 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.716 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.717 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:43.717 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:43.717 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:43.717 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:43.717 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:43.726 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:43.726 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:43.726 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:43.745 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-volume 2026-02-25T14:20:43.748 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librbd1 2026-02-25T14:20:43.802 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.865 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:43.865 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:43.866 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:43.866 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:43.866 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:43.866 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:43.875 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:55 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:43.893 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:20:43.940 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-mgr-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:43.959 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:43.959 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:43.960 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:43.981 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr-dashboard 2026-02-25T14:20:44.063 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:00 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:44.063 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:44.128 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:44.131 INFO:teuthology.orchestra.run.trial068.stdout:Package librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:44.146 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:44.147 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:44.147 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:44.150 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:44.150 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:44.150 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:44.167 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados-devel 2026-02-25T14:20:44.172 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rados 2026-02-25T14:20:44.207 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:00:58 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:44.291 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:44.292 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 107 M 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout:Installing weak dependencies: 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout: ceph-debugsource x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 11 M 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:44.293 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:44.294 INFO:teuthology.orchestra.run.trial031.stdout:Install 2 Packages 2026-02-25T14:20:44.294 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:44.294 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 118 M 2026-02-25T14:20:44.294 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 751 M 2026-02-25T14:20:44.294 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:44.302 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:44.367 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-mgr-dashboard-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:44.386 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:44.386 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:44.386 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:44.408 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-25T14:20:44.480 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:00 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:44.494 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:44.559 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:44.565 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 126 k 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:44.566 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:44.567 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:44.567 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 126 k 2026-02-25T14:20:44.567 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 449 k 2026-02-25T14:20:44.567 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:44.578 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:44.579 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:44.579 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:44.600 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rgw 2026-02-25T14:20:44.727 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:44.792 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:44.811 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:44.812 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:44.812 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:44.834 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr-rook 2026-02-25T14:20:44.897 INFO:teuthology.orchestra.run.trial072.stdout:librados-devel-20.2.0-676.gc824a7fa.el9.x86_64. 380 kB/s | 126 kB 00:00 2026-02-25T14:20:44.897 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:44.898 INFO:teuthology.orchestra.run.trial072.stdout:Total 379 kB/s | 126 kB 00:00 2026-02-25T14:20:44.898 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:44.901 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:44.901 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:44.920 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:44.933 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:44.933 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:44.986 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:44.988 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:45.005 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:45.006 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:45.006 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:45.006 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:45.027 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-cephfs 2026-02-25T14:20:45.086 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:45.143 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:45.147 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:45.148 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:45.148 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:45.148 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:45.148 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:45.148 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:45.177 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install libcephfs2 2026-02-25T14:20:45.208 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-mgr-rook-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:45.227 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:45.227 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:45.227 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:45.249 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr-cephadm 2026-02-25T14:20:45.346 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:45.412 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:45.431 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:45.431 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:45.431 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:45.453 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rbd 2026-02-25T14:20:45.497 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:01 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:45.562 INFO:teuthology.orchestra.run.trial072.stdout:Package libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:45.567 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:45.580 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:45.581 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:45.581 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:45.603 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install libcephfs-devel 2026-02-25T14:20:45.633 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-mgr-cephadm-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:45.651 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:45.652 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:45.652 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:45.674 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-fuse 2026-02-25T14:20:45.778 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:45.843 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:45.862 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:45.862 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:20:45.863 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:45.884 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-fuse 2026-02-25T14:20:45.918 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:01 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:45.994 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:46.002 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:46.002 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:46.002 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:20:46.002 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 34 k 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 34 k 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 155 k 2026-02-25T14:20:46.003 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:46.077 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:46.078 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:46.078 INFO:teuthology.orchestra.run.trial021.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:46.078 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout: ceph-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 942 k 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 942 k 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 2.7 M 2026-02-25T14:20:46.079 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:46.206 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:58 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:46.236 INFO:teuthology.orchestra.run.trial072.stdout:libcephfs-devel-20.2.0-676.gc824a7fa.el9.x86_64 147 kB/s | 34 kB 00:00 2026-02-25T14:20:46.237 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:46.237 INFO:teuthology.orchestra.run.trial072.stdout:Total 146 kB/s | 34 kB 00:00 2026-02-25T14:20:46.237 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:46.239 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:46.239 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:46.242 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:46.242 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:46.264 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:46.281 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.291 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:46.292 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:46.292 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 91 k 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 91 k 2026-02-25T14:20:46.293 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 238 k 2026-02-25T14:20:46.294 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:46.340 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.401 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.402 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:46.402 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:46.402 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:46.402 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:46.402 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:46.427 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados2 2026-02-25T14:20:46.444 INFO:teuthology.orchestra.run.trial031.stdout:(1/2): ceph-debugsource-20.2.0-676.gc824a7fa.el 5.1 MB/s | 11 MB 00:02 2026-02-25T14:20:46.602 INFO:teuthology.orchestra.run.trial068.stdout:rbd-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 295 kB/s | 91 kB 00:00 2026-02-25T14:20:46.603 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:46.603 INFO:teuthology.orchestra.run.trial068.stdout:Total 294 kB/s | 91 kB 00:00 2026-02-25T14:20:46.603 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:46.607 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:46.607 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:46.638 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:46.638 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:46.690 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:46.707 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.739 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:46.795 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.803 INFO:teuthology.orchestra.run.trial072.stdout:Package librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:46.822 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:46.823 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:46.823 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:46.843 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librbd1 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:46.860 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:46.874 INFO:teuthology.orchestra.run.trial021.stdout:ceph-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 1.2 MB/s | 942 kB 00:00 2026-02-25T14:20:46.876 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:46.876 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.2 MB/s | 942 kB 00:00 2026-02-25T14:20:46.877 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:46.882 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:46.882 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:46.888 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-mirror 2026-02-25T14:20:46.915 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:46.915 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:47.005 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:47.023 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:47.162 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:03 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:47.210 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:59 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:47.227 INFO:teuthology.orchestra.run.trial072.stdout:Package librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:47.235 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:47.246 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:47.247 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:47.247 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:47.269 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rados 2026-02-25T14:20:47.293 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.9 M 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:47.294 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:47.295 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 2.9 M 2026-02-25T14:20:47.295 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 11 M 2026-02-25T14:20:47.295 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout: ceph-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:47.297 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:47.323 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-volume 2026-02-25T14:20:47.583 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:03 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:47.635 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:00:59 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:47.650 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:47.668 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:47.669 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:47.669 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:47.690 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rgw 2026-02-25T14:20:47.700 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-volume-2:20.2.0-676.gc824a7fa.el9.noarch is already installed. 2026-02-25T14:20:47.718 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:47.719 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:47.719 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:47.740 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librados-devel 2026-02-25T14:20:47.751 INFO:teuthology.orchestra.run.trial068.stdout:rbd-mirror-20.2.0-676.gc824a7fa.el9.x86_64.rpm 6.4 MB/s | 2.9 MB 00:00 2026-02-25T14:20:47.752 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:47.752 INFO:teuthology.orchestra.run.trial068.stdout:Total 6.4 MB/s | 2.9 MB 00:00 2026-02-25T14:20:47.752 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:47.757 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:47.757 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:47.796 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:47.796 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:47.977 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:47.978 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:48.003 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:48.007 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:48.057 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:00 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:48.074 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:48.093 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:48.093 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:48.093 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:48.115 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-cephfs 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout: librados-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 126 k 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:48.141 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:48.142 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:48.142 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:48.142 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 126 k 2026-02-25T14:20:48.142 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 449 k 2026-02-25T14:20:48.142 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:48.285 INFO:teuthology.orchestra.run.trial021.stdout:librados-devel-20.2.0-676.gc824a7fa.el9.x86_64. 887 kB/s | 126 kB 00:00 2026-02-25T14:20:48.285 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:48.285 INFO:teuthology.orchestra.run.trial021.stdout:Total 882 kB/s | 126 kB 00:00 2026-02-25T14:20:48.285 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:48.287 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:48.287 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:48.319 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:48.319 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:48.323 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.324 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:48.324 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:48.324 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:48.324 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:48.324 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:48.351 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-nbd 2026-02-25T14:20:48.373 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:48.391 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.433 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:48.478 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.499 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:48.517 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:48.518 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:48.518 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:48.539 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rbd 2026-02-25T14:20:48.540 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:48.540 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:48.540 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:48.540 INFO:teuthology.orchestra.run.trial021.stdout: librados-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:48.540 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:48.541 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:48.570 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install libcephfs2 2026-02-25T14:20:48.674 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:01:00 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:48.761 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 180 k 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 180 k 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 498 k 2026-02-25T14:20:48.762 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:48.858 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:48.894 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:00 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:48.925 INFO:teuthology.orchestra.run.trial072.stdout:Package python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:48.943 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:48.944 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:20:48.944 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:48.959 INFO:teuthology.orchestra.run.trial021.stdout:Package libcephfs2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:48.965 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-fuse 2026-02-25T14:20:48.977 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:48.977 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:48.978 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:48.999 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install libcephfs-devel 2026-02-25T14:20:49.191 INFO:teuthology.orchestra.run.trial068.stdout:rbd-nbd-20.2.0-676.gc824a7fa.el9.x86_64.rpm 418 kB/s | 180 kB 00:00 2026-02-25T14:20:49.191 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:49.192 INFO:teuthology.orchestra.run.trial068.stdout:Total 417 kB/s | 180 kB 00:00 2026-02-25T14:20:49.192 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:49.196 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:49.196 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:49.227 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:49.228 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:49.278 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:05 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:49.284 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:49.302 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.316 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:01 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:49.338 INFO:teuthology.orchestra.run.trial031.stdout:(2/2): ceph-base-debuginfo-20.2.0-676.gc824a7fa 21 MB/s | 107 MB 00:05 2026-02-25T14:20:49.339 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:49.340 INFO:teuthology.orchestra.run.trial031.stdout:Total 23 MB/s | 118 MB 00:05 2026-02-25T14:20:49.340 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:20:49.344 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:20:49.344 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:20:49.361 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 91 k 2026-02-25T14:20:49.362 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 91 k 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 238 k 2026-02-25T14:20:49.363 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:49.390 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.401 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-devel x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 34 k 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:49.402 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:49.403 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 34 k 2026-02-25T14:20:49.403 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 155 k 2026-02-25T14:20:49.403 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:49.452 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.452 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:49.452 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:20:49.452 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:49.452 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:49.453 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:20:49.481 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:20:49.600 INFO:teuthology.orchestra.run.trial072.stdout:rbd-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 385 kB/s | 91 kB 00:00 2026-02-25T14:20:49.600 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:49.600 INFO:teuthology.orchestra.run.trial072.stdout:Total 383 kB/s | 91 kB 00:00 2026-02-25T14:20:49.600 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:49.605 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:49.605 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:49.615 INFO:teuthology.orchestra.run.trial021.stdout:libcephfs-devel-20.2.0-676.gc824a7fa.el9.x86_64 161 kB/s | 34 kB 00:00 2026-02-25T14:20:49.616 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:49.616 INFO:teuthology.orchestra.run.trial021.stdout:Total 160 kB/s | 34 kB 00:00 2026-02-25T14:20:49.617 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:49.619 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:49.620 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:49.622 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:49.622 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:49.635 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:49.635 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:49.645 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:49.662 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.687 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:49.704 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.722 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.758 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:20:49.758 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs-devel-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:49.785 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:49.788 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.802 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:01:01 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:49.814 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librados2 2026-02-25T14:20:49.851 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:49.851 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:49.851 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:49.852 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:49.852 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:49.852 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:49.879 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-mirror 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 107 M 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:Installing weak dependencies: 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout: ceph-debugsource x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 11 M 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:20:49.887 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:20:49.888 INFO:teuthology.orchestra.run.trial068.stdout:Install 2 Packages 2026-02-25T14:20:49.888 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:20:49.888 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 118 M 2026-02-25T14:20:49.888 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 751 M 2026-02-25T14:20:49.888 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:20:50.133 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:50.195 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:06 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:50.198 INFO:teuthology.orchestra.run.trial021.stdout:Package librados2-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:50.217 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:50.217 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:50.218 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:50.239 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librbd1 2026-02-25T14:20:50.279 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:50.279 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:50.279 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:20:50.279 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:50.279 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.9 M 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 2.9 M 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 11 M 2026-02-25T14:20:50.280 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:50.553 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:50.619 INFO:teuthology.orchestra.run.trial021.stdout:Package librbd1-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:50.637 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:50.638 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:50.638 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:50.660 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rados 2026-02-25T14:20:50.981 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:51.003 INFO:teuthology.orchestra.run.trial072.stdout:rbd-mirror-20.2.0-676.gc824a7fa.el9.x86_64.rpm 4.0 MB/s | 2.9 MB 00:00 2026-02-25T14:20:51.004 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:51.004 INFO:teuthology.orchestra.run.trial072.stdout:Total 4.0 MB/s | 2.9 MB 00:00 2026-02-25T14:20:51.004 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:51.009 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:51.009 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:51.046 INFO:teuthology.orchestra.run.trial021.stdout:Package python3-rados-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:51.047 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:51.048 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:51.065 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:51.065 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:51.065 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:51.086 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rgw 2026-02-25T14:20:51.228 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:51.229 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:51.252 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:51.404 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:03 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:51.469 INFO:teuthology.orchestra.run.trial021.stdout:Package python3-rgw-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:51.487 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:51.488 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:51.488 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:51.510 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-cephfs 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:51.583 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:51.612 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-nbd 2026-02-25T14:20:51.823 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:03 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:51.889 INFO:teuthology.orchestra.run.trial021.stdout:Package python3-cephfs-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:51.908 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:51.908 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:51.908 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:51.927 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:07 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:51.930 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rbd 2026-02-25T14:20:51.943 INFO:teuthology.orchestra.run.trial068.stdout:(1/2): ceph-debugsource-20.2.0-676.gc824a7fa.el 5.4 MB/s | 11 MB 00:02 2026-02-25T14:20:52.010 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:52.011 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.011 INFO:teuthology.orchestra.run.trial072.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:52.011 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.011 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 180 k 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 180 k 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 498 k 2026-02-25T14:20:52.012 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:52.167 INFO:teuthology.orchestra.run.trial072.stdout:rbd-nbd-20.2.0-676.gc824a7fa.el9.x86_64.rpm 1.1 MB/s | 180 kB 00:00 2026-02-25T14:20:52.168 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:52.168 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.1 MB/s | 180 kB 00:00 2026-02-25T14:20:52.168 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:20:52.172 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:20:52.173 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:20:52.204 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:20:52.204 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:20:52.242 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:20:52.251 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:52.262 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:20:52.280 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:52.316 INFO:teuthology.orchestra.run.trial021.stdout:Package python3-rbd-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:20:52.334 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:52.336 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:20:52.336 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:52.357 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-fuse 2026-02-25T14:20:52.366 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.429 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:20:52.459 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:20:52.669 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:52.753 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:52.754 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:52.754 INFO:teuthology.orchestra.run.trial021.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:52.754 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:52.754 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:52.754 INFO:teuthology.orchestra.run.trial021.stdout: rbd-fuse x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 91 k 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 91 k 2026-02-25T14:20:52.755 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 238 k 2026-02-25T14:20:52.756 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:52.779 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:08 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:20:52.863 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:20:52.864 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.864 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 107 M 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:Installing weak dependencies: 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout: ceph-debugsource x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 11 M 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:Install 2 Packages 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:20:52.865 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 118 M 2026-02-25T14:20:52.866 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 751 M 2026-02-25T14:20:52.866 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:20:53.054 INFO:teuthology.orchestra.run.trial021.stdout:rbd-fuse-20.2.0-676.gc824a7fa.el9.x86_64.rpm 303 kB/s | 91 kB 00:00 2026-02-25T14:20:53.056 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:53.056 INFO:teuthology.orchestra.run.trial021.stdout:Total 300 kB/s | 91 kB 00:00 2026-02-25T14:20:53.056 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:53.061 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:53.061 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:53.092 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:53.092 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:53.144 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:53.162 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:53.245 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:53.308 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:53.308 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:53.308 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:53.308 INFO:teuthology.orchestra.run.trial021.stdout: rbd-fuse-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:53.308 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:53.309 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:53.336 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-mirror 2026-02-25T14:20:53.655 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:05 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:53.738 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:53.738 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:53.738 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout: rbd-mirror x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.9 M 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 2.9 M 2026-02-25T14:20:53.739 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 11 M 2026-02-25T14:20:53.740 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:53.906 INFO:teuthology.orchestra.run.trial072.stdout:(1/2): ceph-debugsource-20.2.0-676.gc824a7fa.el 11 MB/s | 11 MB 00:01 2026-02-25T14:20:54.124 INFO:teuthology.orchestra.run.trial068.stdout:(2/2): ceph-base-debuginfo-20.2.0-676.gc824a7fa 25 MB/s | 107 MB 00:04 2026-02-25T14:20:54.125 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:54.125 INFO:teuthology.orchestra.run.trial068.stdout:Total 28 MB/s | 118 MB 00:04 2026-02-25T14:20:54.126 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:20:54.130 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:20:54.131 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:20:54.216 INFO:teuthology.orchestra.run.trial021.stdout:rbd-mirror-20.2.0-676.gc824a7fa.el9.x86_64.rpm 6.1 MB/s | 2.9 MB 00:00 2026-02-25T14:20:54.217 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:54.217 INFO:teuthology.orchestra.run.trial021.stdout:Total 6.1 MB/s | 2.9 MB 00:00 2026-02-25T14:20:54.217 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:54.221 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:54.222 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:54.261 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:54.261 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:54.441 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:54.442 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:54.465 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:54.466 INFO:teuthology.orchestra.run.trial021.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T14:20:54.466 INFO:teuthology.orchestra.run.trial021.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T14:20:54.466 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:54.466 INFO:teuthology.orchestra.run.trial021.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T14:20:54.466 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:54.543 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:20:54.543 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:20:54.771 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:54.772 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:54.772 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:54.772 INFO:teuthology.orchestra.run.trial021.stdout: rbd-mirror-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:54.772 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:54.772 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:54.801 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-nbd 2026-02-25T14:20:55.120 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:07 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:55.205 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:55.205 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.205 INFO:teuthology.orchestra.run.trial021.stdout: Package Architecture Version Repository Size 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout: rbd-nbd x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 180 k 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 180 k 2026-02-25T14:20:55.206 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 498 k 2026-02-25T14:20:55.207 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:55.291 INFO:teuthology.orchestra.run.trial021.stdout:rbd-nbd-20.2.0-676.gc824a7fa.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-25T14:20:55.291 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:20:55.291 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-25T14:20:55.292 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:20:55.296 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:20:55.296 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:20:55.327 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:20:55.327 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:20:55.383 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:20:55.401 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:55.489 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:55.553 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:20:55.553 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.553 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:20:55.553 INFO:teuthology.orchestra.run.trial021.stdout: rbd-nbd-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:55.554 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.554 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:20:55.581 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:20:55.901 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:01:07 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout: ceph-base-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 107 M 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:Installing weak dependencies: 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout: ceph-debugsource x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 11 M 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout:Install 2 Packages 2026-02-25T14:20:55.985 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:20:55.986 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 118 M 2026-02-25T14:20:55.986 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 751 M 2026-02-25T14:20:55.986 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:20:57.019 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:20:57.954 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 1/2 2026-02-25T14:20:57.974 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:20:58.539 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:20:58.539 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/2 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2/2 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout: ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:58.603 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:20:58.644 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:20:58.964 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:01:12 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:20:59.048 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 586 M 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 586 M 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 3.5 G 2026-02-25T14:20:59.049 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:20:59.497 INFO:teuthology.orchestra.run.trial021.stdout:(1/2): ceph-debugsource-20.2.0-676.gc824a7fa.el 3.2 MB/s | 11 MB 00:03 2026-02-25T14:21:02.561 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 1/2 2026-02-25T14:21:02.581 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:03.209 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:03.210 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/2 2026-02-25T14:21:03.273 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2/2 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout: ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:21:03.274 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:21:03.314 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:21:03.625 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 586 M 2026-02-25T14:21:03.711 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 586 M 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 3.5 G 2026-02-25T14:21:03.712 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:21:06.877 INFO:teuthology.orchestra.run.trial072.stdout:(2/2): ceph-base-debuginfo-20.2.0-676.gc824a7fa 7.6 MB/s | 107 MB 00:14 2026-02-25T14:21:06.879 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:21:06.879 INFO:teuthology.orchestra.run.trial072.stdout:Total 8.4 MB/s | 118 MB 00:14 2026-02-25T14:21:06.880 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:21:06.884 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:21:06.884 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:21:07.297 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:21:07.297 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:21:09.756 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:21:15.383 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 1/2 2026-02-25T14:21:15.403 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:16.042 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:16.042 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/2 2026-02-25T14:21:16.104 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2/2 2026-02-25T14:21:16.104 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:21:16.104 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:21:16.104 INFO:teuthology.orchestra.run.trial072.stdout: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:16.105 INFO:teuthology.orchestra.run.trial072.stdout: ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:16.105 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:21:16.105 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:21:16.143 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:21:16.457 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:21:16.542 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 586 M 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 586 M 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 3.5 G 2026-02-25T14:21:16.543 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:21:38.944 INFO:teuthology.orchestra.run.trial021.stdout:(2/2): ceph-base-debuginfo-20.2.0-676.gc824a7fa 2.5 MB/s | 107 MB 00:42 2026-02-25T14:21:38.946 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:21:38.946 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.7 MB/s | 118 MB 00:42 2026-02-25T14:21:38.946 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:21:38.951 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:21:38.951 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:21:39.364 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:21:39.364 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:21:41.846 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:21:47.603 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 1/2 2026-02-25T14:21:47.623 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:48.240 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 2/2 2026-02-25T14:21:48.240 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/2 2026-02-25T14:21:48.302 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2/2 2026-02-25T14:21:48.302 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:21:48.303 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:21:48.303 INFO:teuthology.orchestra.run.trial021.stdout: ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:48.303 INFO:teuthology.orchestra.run.trial021.stdout: ceph-debugsource-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:21:48.303 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:21:48.303 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:21:48.343 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-common-debuginfo 2026-02-25T14:21:48.657 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:02:00 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:21:48.742 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout: ceph-common-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 586 M 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:21:48.743 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:21:48.744 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:21:48.744 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 586 M 2026-02-25T14:21:48.744 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 3.5 G 2026-02-25T14:21:48.744 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:22:20.834 INFO:teuthology.orchestra.run.trial068.stdout:ceph-common-debuginfo-20.2.0-676.gc824a7fa.el9. 7.6 MB/s | 586 MB 01:17 2026-02-25T14:22:20.835 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:22:20.835 INFO:teuthology.orchestra.run.trial068.stdout:Total 7.6 MB/s | 586 MB 01:17 2026-02-25T14:22:20.836 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:22:20.837 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:22:20.838 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:22:22.578 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:22:22.578 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:22:55.002 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:22:55.021 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:22:56.263 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:22:56.326 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:22:56.327 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:56.327 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:22:56.327 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:22:56.327 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:56.327 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:22:56.405 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:22:56.720 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:03:08 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout:======================================================================================= 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout:======================================================================================= 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.0 M 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:56.804 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout:======================================================================================= 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 3.0 M 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 15 M 2026-02-25T14:22:56.805 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:22:57.849 INFO:teuthology.orchestra.run.trial068.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-67 2.9 MB/s | 3.0 MB 00:01 2026-02-25T14:22:57.849 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:22:57.849 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.9 MB/s | 3.0 MB 00:01 2026-02-25T14:22:57.850 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:22:57.852 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:22:57.852 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:22:57.878 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:22:57.878 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:22:58.068 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:22:58.086 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:22:58.158 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:58.221 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:22:58.247 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:22:58.567 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:03:10 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:22:58.653 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:22:58.654 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:22:58.654 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:22:58.654 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:22:58.654 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 543 M 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:22:58.655 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:22:58.656 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 543 M 2026-02-25T14:22:58.656 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 4.1 G 2026-02-25T14:22:58.656 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:24:56.349 INFO:teuthology.orchestra.run.trial021.stdout:ceph-common-debuginfo-20.2.0-676.gc824a7fa.el9. 3.1 MB/s | 586 MB 03:07 2026-02-25T14:24:56.350 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:24:56.350 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.1 MB/s | 586 MB 03:07 2026-02-25T14:24:56.350 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:24:56.352 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:24:56.352 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:24:58.089 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:24:58.089 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:25:30.002 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:25:30.021 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:25:31.317 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:31.381 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:25:31.466 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:25:31.781 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:05:43 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:25:31.865 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:25:31.866 INFO:teuthology.orchestra.run.trial021.stdout:======================================================================================= 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout:======================================================================================= 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.0 M 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:25:31.867 INFO:teuthology.orchestra.run.trial021.stdout:======================================================================================= 2026-02-25T14:25:31.868 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:25:31.868 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:31.868 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 3.0 M 2026-02-25T14:25:31.868 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 15 M 2026-02-25T14:25:31.868 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:25:33.162 INFO:teuthology.orchestra.run.trial021.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-67 2.3 MB/s | 3.0 MB 00:01 2026-02-25T14:25:33.162 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:25:33.162 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.3 MB/s | 3.0 MB 00:01 2026-02-25T14:25:33.162 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:25:33.164 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:25:33.164 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:25:33.190 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:25:33.190 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:25:33.379 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:25:33.398 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:25:33.470 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:25:33.533 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:25:33.533 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:33.533 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:25:33.533 INFO:teuthology.orchestra.run.trial021.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:25:33.534 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:33.534 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:25:33.560 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:25:33.879 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:05:45 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:25:33.962 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 543 M 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:25:33.963 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:25:33.964 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:25:33.964 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:25:33.964 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 543 M 2026-02-25T14:25:33.964 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 4.1 G 2026-02-25T14:25:33.964 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:26:08.933 INFO:teuthology.orchestra.run.trial072.stdout:ceph-common-debuginfo-20.2.0-676.gc824a7fa.el9. 2.0 MB/s | 586 MB 04:52 2026-02-25T14:26:08.933 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:08.934 INFO:teuthology.orchestra.run.trial072.stdout:Total 2.0 MB/s | 586 MB 04:52 2026-02-25T14:26:08.934 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:26:08.936 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:26:08.936 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:26:10.678 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:26:10.678 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:26:42.682 INFO:teuthology.orchestra.run.trial031.stdout:ceph-common-debuginfo-20.2.0-676.gc824a7fa.el9. 1.7 MB/s | 586 MB 05:43 2026-02-25T14:26:42.682 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:42.682 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.7 MB/s | 586 MB 05:43 2026-02-25T14:26:42.683 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:26:42.685 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:26:42.685 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:26:43.873 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:26:43.891 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:26:44.428 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:26:44.428 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:26:45.276 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:26:45.339 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:26:45.340 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:45.340 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:26:45.340 INFO:teuthology.orchestra.run.trial072.stdout: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:26:45.340 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:45.340 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:26:45.428 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:26:45.753 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:07:01 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout:======================================================================================= 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout:======================================================================================= 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:26:45.839 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.0 M 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:======================================================================================= 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 3.0 M 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 15 M 2026-02-25T14:26:45.840 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:26:46.712 INFO:teuthology.orchestra.run.trial072.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-67 3.5 MB/s | 3.0 MB 00:00 2026-02-25T14:26:46.713 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:26:46.713 INFO:teuthology.orchestra.run.trial072.stdout:Total 3.5 MB/s | 3.0 MB 00:00 2026-02-25T14:26:46.713 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:26:46.714 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:26:46.715 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:26:46.743 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:26:46.744 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:26:46.940 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:26:46.958 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:26:47.029 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:47.092 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:26:47.120 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:26:47.443 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:07:03 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:26:47.527 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:26:47.527 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 543 M 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:26:47.528 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 543 M 2026-02-25T14:26:47.529 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 4.1 G 2026-02-25T14:26:47.529 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:27:17.854 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:27:17.873 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:27:19.145 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout: ceph-common-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:19.208 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:27:19.299 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-25T14:27:19.621 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:07:33 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:27:19.705 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout:======================================================================================= 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout:======================================================================================= 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 3.0 M 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:19.706 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout:======================================================================================= 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 3.0 M 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 15 M 2026-02-25T14:27:19.707 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:27:25.100 INFO:teuthology.orchestra.run.trial031.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-67 576 kB/s | 3.0 MB 00:05 2026-02-25T14:27:25.101 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:27:25.101 INFO:teuthology.orchestra.run.trial031.stdout:Total 575 kB/s | 3.0 MB 00:05 2026-02-25T14:27:25.101 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:27:25.103 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:27:25.103 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:27:25.130 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:27:25.130 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:27:25.321 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:27:25.340 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:27:25.412 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:27:25.475 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-676.g 1/1 2026-02-25T14:27:25.476 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:25.476 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:27:25.476 INFO:teuthology.orchestra.run.trial031.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:27:25.476 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:25.476 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:27:25.504 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-25T14:27:25.825 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:07:39 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:27:25.910 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 543 M 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:27:25.911 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:27:25.912 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 543 M 2026-02-25T14:27:25.912 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 4.1 G 2026-02-25T14:27:25.912 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:28:07.546 INFO:teuthology.orchestra.run.trial068.stdout:ceph-radosgw-debuginfo-20.2.0-676.gc824a7fa.el9 1.8 MB/s | 543 MB 05:08 2026-02-25T14:28:07.547 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:07.547 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.8 MB/s | 543 MB 05:08 2026-02-25T14:28:07.548 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:28:07.550 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:28:07.550 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:28:09.161 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:28:09.161 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:28:42.016 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:28:42.034 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:28:42.296 INFO:teuthology.orchestra.run.trial021.stdout:ceph-radosgw-debuginfo-20.2.0-676.gc824a7fa.el9 2.9 MB/s | 543 MB 03:08 2026-02-25T14:28:42.296 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:28:42.297 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.9 MB/s | 543 MB 03:08 2026-02-25T14:28:42.297 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:28:42.299 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:28:42.299 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:28:43.553 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:28:43.615 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:28:43.615 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:28:43.615 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:28:43.615 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:28:43.616 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:28:43.616 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:28:43.692 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:28:43.908 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:28:43.908 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:28:44.010 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:08:56 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:28:44.093 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.7 G 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:28:44.094 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 1.7 G 2026-02-25T14:28:44.095 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 12 G 2026-02-25T14:28:44.095 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:29:16.188 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:29:16.207 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:29:17.719 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:29:17.782 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:29:17.860 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:29:18.183 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:09:30 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:29:18.266 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:29:18.267 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:29:18.267 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:29:18.267 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:29:18.267 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout: ceph-test-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.7 G 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 1.7 G 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 12 G 2026-02-25T14:29:18.268 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:32:20.074 INFO:teuthology.orchestra.run.trial031.stdout:ceph-radosgw-debuginfo-20.2.0-676.gc824a7fa.el9 1.8 MB/s | 543 MB 04:54 2026-02-25T14:32:20.075 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:32:20.075 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.8 MB/s | 543 MB 04:54 2026-02-25T14:32:20.075 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:32:20.076 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:32:20.076 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:32:21.694 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:32:21.694 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:32:54.551 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:32:54.569 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:32:56.087 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:32:56.150 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:32:56.151 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:32:56.151 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:32:56.151 INFO:teuthology.orchestra.run.trial031.stdout: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:32:56.151 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:32:56.151 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:32:56.227 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:32:56.541 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:13:10 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.7 G 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:32:56.624 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:32:56.625 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:32:56.625 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:32:56.625 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 1.7 G 2026-02-25T14:32:56.625 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 12 G 2026-02-25T14:32:56.625 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:33:00.216 INFO:teuthology.orchestra.run.trial072.stdout:ceph-radosgw-debuginfo-20.2.0-676.gc824a7fa.el9 1.5 MB/s | 543 MB 06:12 2026-02-25T14:33:00.216 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:33:00.217 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.5 MB/s | 543 MB 06:12 2026-02-25T14:33:00.217 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:33:00.219 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:33:00.219 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:33:01.836 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:33:01.836 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:33:34.133 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:33:34.152 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:33:34.965 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:33:35.028 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x8 1/1 2026-02-25T14:33:35.028 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:33:35.028 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:33:35.028 INFO:teuthology.orchestra.run.trial072.stdout: ceph-radosgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:33:35.028 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:33:35.029 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:33:35.110 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-test-debuginfo 2026-02-25T14:33:35.432 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:13:51 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:33:35.515 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.7 G 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:33:35.516 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:33:35.517 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:33:35.517 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 1.7 G 2026-02-25T14:33:35.517 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 12 G 2026-02-25T14:33:35.517 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:41:58.967 INFO:teuthology.orchestra.run.trial068.stdout:ceph-test-debuginfo-20.2.0-676.gc824a7fa.el9.x8 2.2 MB/s | 1.7 GB 13:14 2026-02-25T14:41:58.967 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:41:58.968 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.2 MB/s | 1.7 GB 13:14 2026-02-25T14:41:58.968 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:41:58.971 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:41:58.971 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:42:04.171 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:42:04.172 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:43:48.592 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:43:48.612 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:43:51.109 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:43:51.171 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:43:51.172 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:43:51.172 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:43:51.172 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:43:51.172 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:43:51.172 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:43:51.377 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:43:51.717 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:24:03 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:43:51.784 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:43:51.802 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:43:51.802 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-25T14:43:51.802 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:43:51.825 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:43:52.146 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:24:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:43:52.230 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:43:52.230 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:43:52.230 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 22 M 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 22 M 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 146 M 2026-02-25T14:43:52.231 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:44:04.519 INFO:teuthology.orchestra.run.trial068.stdout:ceph-mgr-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.8 MB/s | 22 MB 00:12 2026-02-25T14:44:04.520 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:44:04.520 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.8 MB/s | 22 MB 00:12 2026-02-25T14:44:04.520 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:44:04.521 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:44:04.522 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:44:04.603 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:44:04.604 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:44:05.859 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:44:05.877 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:06.044 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:06.110 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:06.111 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:06.111 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:44:06.111 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:44:06.111 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:06.111 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:44:06.140 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:44:06.457 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:24:18 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:44:06.541 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:44:06.541 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:06.541 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:44:06.541 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 54 M 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 54 M 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 221 M 2026-02-25T14:44:06.542 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:44:21.533 INFO:teuthology.orchestra.run.trial068.stdout:ceph-mds-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.6 MB/s | 54 MB 00:14 2026-02-25T14:44:21.533 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:44:21.534 INFO:teuthology.orchestra.run.trial068.stdout:Total 3.6 MB/s | 54 MB 00:14 2026-02-25T14:44:21.534 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:44:21.536 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:44:21.536 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:44:21.713 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:44:21.713 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:44:24.456 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:44:24.475 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:24.677 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:24.739 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:44:24.740 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:24.740 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:44:24.740 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:44:24.740 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:24.740 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:44:24.770 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:44:25.089 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:24:37 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:44:25.174 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:44:25.174 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:25.174 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:44:25.174 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 129 M 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 129 M 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 641 M 2026-02-25T14:44:25.175 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:45:44.142 INFO:teuthology.orchestra.run.trial068.stdout:ceph-mon-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.6 MB/s | 129 MB 01:18 2026-02-25T14:45:44.143 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:45:44.143 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.6 MB/s | 129 MB 01:18 2026-02-25T14:45:44.143 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:45:44.144 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:45:44.144 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:45:44.539 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:45:44.540 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:45:51.154 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:45:51.173 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:45:51.714 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:45:51.777 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:45:51.778 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:45:51.778 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:45:51.778 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:45:51.778 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:45:51.778 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:45:51.813 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:45:52.123 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:26:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:45:52.206 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:45:52.206 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:45:52.206 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 343 M 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 343 M 2026-02-25T14:45:52.207 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 1.6 G 2026-02-25T14:45:52.208 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:47:38.803 INFO:teuthology.orchestra.run.trial031.stdout:ceph-test-debuginfo-20.2.0-676.gc824a7fa.el9.x8 2.0 MB/s | 1.7 GB 14:42 2026-02-25T14:47:38.804 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:47:38.804 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.0 MB/s | 1.7 GB 14:42 2026-02-25T14:47:38.804 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:47:38.807 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:47:38.807 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:47:44.005 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:47:44.005 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:48:17.471 INFO:teuthology.orchestra.run.trial072.stdout:ceph-test-debuginfo-20.2.0-676.gc824a7fa.el9.x8 2.0 MB/s | 1.7 GB 14:41 2026-02-25T14:48:17.471 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:48:17.472 INFO:teuthology.orchestra.run.trial072.stdout:Total 2.0 MB/s | 1.7 GB 14:41 2026-02-25T14:48:17.472 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:48:17.475 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:48:17.476 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:48:22.651 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:48:22.651 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:48:25.430 INFO:teuthology.orchestra.run.trial068.stdout:ceph-osd-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.2 MB/s | 343 MB 02:33 2026-02-25T14:48:25.430 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:48:25.431 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.2 MB/s | 343 MB 02:33 2026-02-25T14:48:25.431 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:48:25.432 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:48:25.432 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:48:26.455 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:48:26.455 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:48:43.703 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:48:43.721 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:48:44.927 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:48:44.990 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:48:44.990 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:44.991 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:48:44.991 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:48:44.991 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:44.991 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:48:45.051 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T14:48:45.373 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:28:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:48:45.457 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:48:45.457 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 10 M 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:45.458 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 10 M 2026-02-25T14:48:45.459 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 51 M 2026-02-25T14:48:45.459 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:48:53.453 INFO:teuthology.orchestra.run.trial068.stdout:ceph-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x8 1.3 MB/s | 10 MB 00:07 2026-02-25T14:48:53.454 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:48:53.454 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.3 MB/s | 10 MB 00:07 2026-02-25T14:48:53.454 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:48:53.455 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:48:53.455 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:48:53.502 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:48:53.503 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:48:54.076 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:48:54.094 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:48:54.191 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:48:54.254 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:48:54.254 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:54.254 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:48:54.254 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:48:54.255 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:54.255 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:48:54.281 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados-devel-debuginfo 2026-02-25T14:48:54.594 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:29:06 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:48:54.679 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 144 k 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:48:54.680 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:54.681 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 144 k 2026-02-25T14:48:54.681 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 802 k 2026-02-25T14:48:54.681 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:48:55.172 INFO:teuthology.orchestra.run.trial068.stdout:librados-devel-debuginfo-20.2.0-676.gc824a7fa.e 292 kB/s | 144 kB 00:00 2026-02-25T14:48:55.173 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:48:55.173 INFO:teuthology.orchestra.run.trial068.stdout:Total 291 kB/s | 144 kB 00:00 2026-02-25T14:48:55.173 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:48:55.175 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:48:55.175 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:48:55.193 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:48:55.194 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:48:55.238 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:48:55.256 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:48:55.317 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:48:55.381 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:48:55.382 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:55.382 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:48:55.382 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:48:55.382 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:55.382 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:48:55.408 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T14:48:55.722 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:29:07 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:48:55.806 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 9.1 M 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:48:55.807 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:55.808 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:48:55.808 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:55.808 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 9.1 M 2026-02-25T14:48:55.808 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 46 M 2026-02-25T14:48:55.808 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:48:58.621 INFO:teuthology.orchestra.run.trial068.stdout:libcephfs2-debuginfo-20.2.0-676.gc824a7fa.el9.x 3.2 MB/s | 9.1 MB 00:02 2026-02-25T14:48:58.622 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:48:58.622 INFO:teuthology.orchestra.run.trial068.stdout:Total 3.2 MB/s | 9.1 MB 00:02 2026-02-25T14:48:58.622 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:48:58.624 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:48:58.624 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:48:58.667 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:48:58.668 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:48:59.172 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:48:59.190 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:48:59.283 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:59.346 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:48:59.374 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados2-debuginfo 2026-02-25T14:48:59.693 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:29:11 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:48:59.776 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout: librados2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 63 M 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:48:59.777 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:48:59.778 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:48:59.778 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:48:59.778 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 63 M 2026-02-25T14:48:59.778 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 397 M 2026-02-25T14:48:59.778 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:49:24.133 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:49:24.154 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:27.285 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:27.349 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:49:27.554 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:49:27.880 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:29:41 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:49:27.946 INFO:teuthology.orchestra.run.trial031.stdout:Package ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:49:27.964 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:49:27.964 INFO:teuthology.orchestra.run.trial031.stdout:Nothing to do. 2026-02-25T14:49:27.964 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:49:27.986 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:49:28.311 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:29:42 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:49:28.395 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:49:28.396 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:28.396 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:49:28.396 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:28.396 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:49:28.396 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 22 M 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 22 M 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 146 M 2026-02-25T14:49:28.397 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:49:36.002 INFO:teuthology.orchestra.run.trial031.stdout:ceph-mgr-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.9 MB/s | 22 MB 00:07 2026-02-25T14:49:36.003 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:49:36.003 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.9 MB/s | 22 MB 00:07 2026-02-25T14:49:36.003 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:49:36.005 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:49:36.005 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:49:36.087 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:49:36.087 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:49:37.344 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:49:37.362 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:49:37.535 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:49:37.599 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:49:37.599 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:37.600 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:49:37.600 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:49:37.600 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:37.600 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:49:37.628 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:49:37.947 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:29:51 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 54 M 2026-02-25T14:49:38.030 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 54 M 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 221 M 2026-02-25T14:49:38.031 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:49:42.602 INFO:teuthology.orchestra.run.trial068.stdout:librados2-debuginfo-20.2.0-676.gc824a7fa.el9.x8 1.5 MB/s | 63 MB 00:42 2026-02-25T14:49:42.603 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:49:42.604 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.5 MB/s | 63 MB 00:42 2026-02-25T14:49:42.604 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:49:42.605 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:49:42.606 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:49:42.811 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:49:42.811 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:49:46.315 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:49:46.333 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:46.662 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:46.725 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:49:46.726 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:49:46.726 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:49:46.726 INFO:teuthology.orchestra.run.trial068.stdout: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:49:46.726 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:49:46.726 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:49:46.757 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librbd1-debuginfo 2026-02-25T14:49:47.069 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:29:59 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:49:47.152 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout: librbd1-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 80 M 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 80 M 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 406 M 2026-02-25T14:49:47.153 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:02.432 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:50:02.453 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:50:04.934 INFO:teuthology.orchestra.run.trial031.stdout:ceph-mds-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.0 MB/s | 54 MB 00:26 2026-02-25T14:50:04.935 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:04.935 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.0 MB/s | 54 MB 00:26 2026-02-25T14:50:04.936 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:50:04.937 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:50:04.937 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:50:05.031 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:50:05.093 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:50:05.093 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:05.093 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:50:05.093 INFO:teuthology.orchestra.run.trial072.stdout: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:05.094 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:05.094 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:50:05.113 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:50:05.113 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:50:05.296 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:50:05.618 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:30:21 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:50:05.683 INFO:teuthology.orchestra.run.trial072.stdout:Package ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:50:05.701 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:50:05.702 INFO:teuthology.orchestra.run.trial072.stdout:Nothing to do. 2026-02-25T14:50:05.702 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:50:05.725 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:50:06.049 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:30:22 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:50:06.131 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 22 M 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:06.132 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:50:06.133 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:06.133 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 22 M 2026-02-25T14:50:06.133 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 146 M 2026-02-25T14:50:06.133 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:50:07.817 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:50:07.835 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:08.055 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:08.119 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:08.119 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:50:08.119 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:50:08.119 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:08.119 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:50:08.120 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:50:08.148 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:50:08.469 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:30:22 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:50:08.553 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 129 M 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:50:08.554 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:50:08.555 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:50:08.555 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 129 M 2026-02-25T14:50:08.555 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 641 M 2026-02-25T14:50:08.555 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:50:10.745 INFO:teuthology.orchestra.run.trial072.stdout:ceph-mgr-debuginfo-20.2.0-676.gc824a7fa.el9.x86 4.7 MB/s | 22 MB 00:04 2026-02-25T14:50:10.745 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:10.746 INFO:teuthology.orchestra.run.trial072.stdout:Total 4.7 MB/s | 22 MB 00:04 2026-02-25T14:50:10.746 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:50:10.747 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:50:10.748 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:50:10.829 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:50:10.829 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:50:12.108 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:50:12.127 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:12.296 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:12.358 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:12.359 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:12.359 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:50:12.359 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:12.359 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:12.359 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:50:12.388 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:50:12.709 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:30:28 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:50:12.792 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:50:12.793 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:12.793 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:50:12.793 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:12.793 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 54 M 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 54 M 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 221 M 2026-02-25T14:50:12.794 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:50:29.670 INFO:teuthology.orchestra.run.trial072.stdout:ceph-mds-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.2 MB/s | 54 MB 00:16 2026-02-25T14:50:29.671 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:29.671 INFO:teuthology.orchestra.run.trial072.stdout:Total 3.2 MB/s | 54 MB 00:16 2026-02-25T14:50:29.671 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:50:29.673 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:50:29.673 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:50:29.849 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:50:29.850 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:50:32.645 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:50:32.663 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:32.896 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:32.959 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:32.959 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:32.959 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:50:32.960 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:32.960 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:32.960 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:50:32.991 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:50:33.304 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:30:49 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:50:33.387 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 129 M 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:50:33.388 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:50:33.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:50:33.389 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 129 M 2026-02-25T14:50:33.389 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 641 M 2026-02-25T14:50:33.389 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:50:38.399 INFO:teuthology.orchestra.run.trial068.stdout:librbd1-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 1.6 MB/s | 80 MB 00:51 2026-02-25T14:50:38.400 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:38.400 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.6 MB/s | 80 MB 00:51 2026-02-25T14:50:38.400 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:38.402 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:38.402 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:38.658 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:38.659 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:43.021 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:43.040 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:43.412 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:43.476 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:43.477 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:43.477 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:43.477 INFO:teuthology.orchestra.run.trial068.stdout: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:43.477 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:43.477 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:43.509 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T14:50:43.831 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:30:55 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:43.913 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 646 k 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:43.914 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:43.915 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:43.915 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 646 k 2026-02-25T14:50:43.915 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 2.3 M 2026-02-25T14:50:43.915 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:45.012 INFO:teuthology.orchestra.run.trial068.stdout:python3-cephfs-debuginfo-20.2.0-676.gc824a7fa.e 588 kB/s | 646 kB 00:01 2026-02-25T14:50:45.012 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:45.012 INFO:teuthology.orchestra.run.trial068.stdout:Total 588 kB/s | 646 kB 00:01 2026-02-25T14:50:45.012 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:45.014 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:45.014 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:45.034 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:45.035 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:45.100 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:45.118 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:50:45.180 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:50:45.243 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:50:45.243 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:45.244 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:45.244 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:45.244 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:45.244 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:45.270 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rados-debuginfo 2026-02-25T14:50:45.585 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:30:57 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:45.668 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 800 k 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:45.669 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:45.670 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:45.670 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 800 k 2026-02-25T14:50:45.670 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 3.1 M 2026-02-25T14:50:45.670 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:46.860 INFO:teuthology.orchestra.run.trial068.stdout:python3-rados-debuginfo-20.2.0-676.gc824a7fa.el 671 kB/s | 800 kB 00:01 2026-02-25T14:50:46.861 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:46.861 INFO:teuthology.orchestra.run.trial068.stdout:Total 671 kB/s | 800 kB 00:01 2026-02-25T14:50:46.861 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:46.863 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:46.863 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:46.884 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:46.884 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:46.959 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:46.977 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:50:47.040 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:47.103 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:47.130 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T14:50:47.441 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:30:59 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:47.524 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:47.524 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.2 M 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:47.525 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:47.526 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 1.2 M 2026-02-25T14:50:47.526 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 4.7 M 2026-02-25T14:50:47.526 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:48.640 INFO:teuthology.orchestra.run.trial068.stdout:python3-rbd-debuginfo-20.2.0-676.gc824a7fa.el9. 1.0 MB/s | 1.2 MB 00:01 2026-02-25T14:50:48.640 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:48.641 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.0 MB/s | 1.2 MB 00:01 2026-02-25T14:50:48.641 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:48.643 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:48.644 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:48.664 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:48.665 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:48.756 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:48.774 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:48.837 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:48.900 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:48.900 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:48.900 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:48.901 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:48.901 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:48.901 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:48.926 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T14:50:49.238 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:31:01 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:49.323 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:49.323 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:49.323 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:49.323 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 350 k 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 350 k 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 1.1 M 2026-02-25T14:50:49.324 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:50.034 INFO:teuthology.orchestra.run.trial068.stdout:python3-rgw-debuginfo-20.2.0-676.gc824a7fa.el9. 492 kB/s | 350 kB 00:00 2026-02-25T14:50:50.036 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:50.036 INFO:teuthology.orchestra.run.trial068.stdout:Total 491 kB/s | 350 kB 00:00 2026-02-25T14:50:50.036 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:50.038 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:50.039 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:50.057 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:50.057 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:50.108 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:50.126 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:50.186 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:50.250 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:50:50.250 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:50.250 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:50.250 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:50.250 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:50.251 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:50.276 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T14:50:50.595 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:31:02 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:50.678 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.5 M 2026-02-25T14:50:50.679 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 1.5 M 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 7.9 M 2026-02-25T14:50:50.680 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:50:51.832 INFO:teuthology.orchestra.run.trial068.stdout:rbd-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:50:51.832 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:50:51.832 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:50:51.832 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:50:51.834 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:50:51.834 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:50:51.856 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:50:51.856 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:50:51.968 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:50:51.986 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:52.049 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:52.113 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:50:52.139 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T14:50:52.454 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:31:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:50:52.538 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:50:52.539 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:52.539 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:50:52.539 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:52.539 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:50:52.539 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 79 M 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 79 M 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 375 M 2026-02-25T14:50:52.540 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:51:06.446 INFO:teuthology.orchestra.run.trial031.stdout:ceph-mon-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.2 MB/s | 129 MB 00:57 2026-02-25T14:51:06.447 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:51:06.447 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.2 MB/s | 129 MB 00:57 2026-02-25T14:51:06.447 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:51:06.449 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:51:06.449 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:51:06.848 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:51:06.848 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:51:13.724 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:51:13.743 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:14.285 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:51:14.349 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:51:14.386 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:51:14.703 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:31:28 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:51:14.786 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 343 M 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:51:14.787 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 343 M 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 1.6 G 2026-02-25T14:51:14.788 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:51:26.325 INFO:teuthology.orchestra.run.trial068.stdout:rbd-mirror-debuginfo-20.2.0-676.gc824a7fa.el9.x 2.3 MB/s | 79 MB 00:33 2026-02-25T14:51:26.326 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:51:26.326 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.3 MB/s | 79 MB 00:33 2026-02-25T14:51:26.327 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:51:26.328 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:51:26.328 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:51:26.580 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:51:26.580 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:51:30.640 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:51:30.659 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:51:30.967 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:51:31.030 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:51:31.031 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:31.031 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:51:31.031 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:51:31.031 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:31.031 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:51:31.064 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T14:51:31.384 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:31:43 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:51:31.467 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-25T14:51:31.468 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:51:31.468 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.4 M 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 2.4 M 2026-02-25T14:51:31.469 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 12 M 2026-02-25T14:51:31.470 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-25T14:51:33.172 INFO:teuthology.orchestra.run.trial068.stdout:rbd-nbd-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 1.4 MB/s | 2.4 MB 00:01 2026-02-25T14:51:33.172 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:51:33.173 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.4 MB/s | 2.4 MB 00:01 2026-02-25T14:51:33.173 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-25T14:51:33.174 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-25T14:51:33.174 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-25T14:51:33.198 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-25T14:51:33.199 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-25T14:51:33.360 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-25T14:51:33.378 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:33.449 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:51:33.512 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-25T14:51:33.545 DEBUG:teuthology.parallel:result is None 2026-02-25T14:51:42.261 INFO:teuthology.orchestra.run.trial072.stdout:ceph-mon-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.9 MB/s | 129 MB 01:08 2026-02-25T14:51:42.262 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:51:42.262 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.9 MB/s | 129 MB 01:08 2026-02-25T14:51:42.262 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:51:42.264 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:51:42.264 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:51:42.662 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:51:42.662 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:51:49.281 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:51:49.299 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:49.854 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:51:49.916 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:51:49.955 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:51:50.277 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:32:06 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:51:50.360 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:51:50.361 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:51:50.361 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:51:50.361 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:51:50.361 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:51:50.361 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 343 M 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 343 M 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 1.6 G 2026-02-25T14:51:50.362 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:53:01.542 INFO:teuthology.orchestra.run.trial021.stdout:ceph-test-debuginfo-20.2.0-676.gc824a7fa.el9.x8 1.2 MB/s | 1.7 GB 23:43 2026-02-25T14:53:01.543 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:53:01.543 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.2 MB/s | 1.7 GB 23:43 2026-02-25T14:53:01.544 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:53:01.547 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:53:01.547 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:53:06.738 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:53:06.738 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:53:39.830 INFO:teuthology.orchestra.run.trial031.stdout:ceph-osd-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.4 MB/s | 343 MB 02:25 2026-02-25T14:53:39.831 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:53:39.831 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.4 MB/s | 343 MB 02:25 2026-02-25T14:53:39.832 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:53:39.832 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:53:39.832 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:53:40.852 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:53:40.853 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:53:58.111 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:53:58.129 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:53:59.373 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:53:59.437 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:53:59.437 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:53:59.437 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:53:59.437 INFO:teuthology.orchestra.run.trial031.stdout: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:53:59.438 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:53:59.438 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:53:59.492 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T14:53:59.806 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:34:13 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:53:59.888 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:53:59.889 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:53:59.889 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:53:59.889 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:53:59.889 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 10 M 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 10 M 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 51 M 2026-02-25T14:53:59.890 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:02.719 INFO:teuthology.orchestra.run.trial031.stdout:ceph-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x8 3.6 MB/s | 10 MB 00:02 2026-02-25T14:54:02.719 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:02.719 INFO:teuthology.orchestra.run.trial031.stdout:Total 3.6 MB/s | 10 MB 00:02 2026-02-25T14:54:02.720 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:02.721 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:02.721 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:02.769 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:02.769 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:03.331 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:03.349 INFO:teuthology.orchestra.run.trial031.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:03.450 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:03.515 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:03.515 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:03.515 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:03.515 INFO:teuthology.orchestra.run.trial031.stdout: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:03.516 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:03.516 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:03.542 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados-devel-debuginfo 2026-02-25T14:54:03.857 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:34:17 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:03.941 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:03.941 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:03.941 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 144 k 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 144 k 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 802 k 2026-02-25T14:54:03.942 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:04.559 INFO:teuthology.orchestra.run.trial031.stdout:librados-devel-debuginfo-20.2.0-676.gc824a7fa.e 233 kB/s | 144 kB 00:00 2026-02-25T14:54:04.559 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:04.559 INFO:teuthology.orchestra.run.trial031.stdout:Total 233 kB/s | 144 kB 00:00 2026-02-25T14:54:04.559 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:04.561 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:04.561 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:04.580 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:04.580 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:04.624 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:04.641 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:04.704 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:04.768 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:04.768 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:04.768 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:04.769 INFO:teuthology.orchestra.run.trial031.stdout: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:04.769 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:04.769 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:04.795 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T14:54:05.107 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:34:19 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 9.1 M 2026-02-25T14:54:05.192 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 9.1 M 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 46 M 2026-02-25T14:54:05.193 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:07.764 INFO:teuthology.orchestra.run.trial031.stdout:libcephfs2-debuginfo-20.2.0-676.gc824a7fa.el9.x 3.5 MB/s | 9.1 MB 00:02 2026-02-25T14:54:07.764 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:07.764 INFO:teuthology.orchestra.run.trial031.stdout:Total 3.5 MB/s | 9.1 MB 00:02 2026-02-25T14:54:07.765 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:07.765 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:07.766 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:07.810 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:07.810 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:08.317 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:08.335 INFO:teuthology.orchestra.run.trial031.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:08.431 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:08.495 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:08.522 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librados2-debuginfo 2026-02-25T14:54:08.839 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:34:22 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:08.924 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:08.925 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:08.925 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:08.925 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout: librados2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 63 M 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 63 M 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 397 M 2026-02-25T14:54:08.926 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:21.223 INFO:teuthology.orchestra.run.trial072.stdout:ceph-osd-debuginfo-20.2.0-676.gc824a7fa.el9.x86 2.3 MB/s | 343 MB 02:30 2026-02-25T14:54:21.224 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:21.224 INFO:teuthology.orchestra.run.trial072.stdout:Total 2.3 MB/s | 343 MB 02:30 2026-02-25T14:54:21.224 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:54:21.226 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:54:21.226 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:54:22.251 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:54:22.251 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:54:30.313 INFO:teuthology.orchestra.run.trial031.stdout:librados2-debuginfo-20.2.0-676.gc824a7fa.el9.x8 3.0 MB/s | 63 MB 00:21 2026-02-25T14:54:30.314 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:30.314 INFO:teuthology.orchestra.run.trial031.stdout:Total 3.0 MB/s | 63 MB 00:21 2026-02-25T14:54:30.314 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:30.315 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:30.315 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:30.524 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:30.524 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:34.088 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:34.107 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:34.452 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:34.517 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:34.549 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install librbd1-debuginfo 2026-02-25T14:54:34.867 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:34:48 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:34.950 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout: librbd1-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 80 M 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:34.951 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:34.952 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:34.952 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:34.952 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 80 M 2026-02-25T14:54:34.952 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 406 M 2026-02-25T14:54:34.952 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:40.016 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:54:40.035 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:41.273 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:41.336 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:54:41.393 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T14:54:41.709 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:34:57 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:54:41.792 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:54:41.792 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:41.792 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 10 M 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 10 M 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 51 M 2026-02-25T14:54:41.793 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:54:45.042 INFO:teuthology.orchestra.run.trial072.stdout:ceph-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x8 3.1 MB/s | 10 MB 00:03 2026-02-25T14:54:45.043 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:45.043 INFO:teuthology.orchestra.run.trial072.stdout:Total 3.1 MB/s | 10 MB 00:03 2026-02-25T14:54:45.043 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:54:45.045 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:54:45.045 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:54:45.093 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:54:45.093 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:54:45.643 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:54:45.662 INFO:teuthology.orchestra.run.trial072.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:45.761 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:45.824 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:54:45.851 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados-devel-debuginfo 2026-02-25T14:54:46.165 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:35:02 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:54:46.248 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:54:46.249 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:46.249 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 144 k 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 144 k 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 802 k 2026-02-25T14:54:46.250 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:54:46.483 INFO:teuthology.orchestra.run.trial072.stdout:librados-devel-debuginfo-20.2.0-676.gc824a7fa.e 615 kB/s | 144 kB 00:00 2026-02-25T14:54:46.483 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:46.483 INFO:teuthology.orchestra.run.trial072.stdout:Total 613 kB/s | 144 kB 00:00 2026-02-25T14:54:46.484 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:54:46.485 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:54:46.485 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:54:46.504 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:54:46.504 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:54:46.546 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:54:46.563 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:46.624 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:46.645 INFO:teuthology.orchestra.run.trial031.stdout:librbd1-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 6.9 MB/s | 80 MB 00:11 2026-02-25T14:54:46.645 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:46.646 INFO:teuthology.orchestra.run.trial031.stdout:Total 6.9 MB/s | 80 MB 00:11 2026-02-25T14:54:46.646 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:46.647 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:46.648 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:46.686 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:46.687 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:46.687 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:54:46.687 INFO:teuthology.orchestra.run.trial072.stdout: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:46.687 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:46.687 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:54:46.714 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T14:54:46.904 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:46.904 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:47.030 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:35:03 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:54:47.113 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 9.1 M 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:54:47.114 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:47.115 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 9.1 M 2026-02-25T14:54:47.115 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 46 M 2026-02-25T14:54:47.115 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:54:48.223 INFO:teuthology.orchestra.run.trial072.stdout:libcephfs2-debuginfo-20.2.0-676.gc824a7fa.el9.x 8.2 MB/s | 9.1 MB 00:01 2026-02-25T14:54:48.223 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:48.224 INFO:teuthology.orchestra.run.trial072.stdout:Total 8.2 MB/s | 9.1 MB 00:01 2026-02-25T14:54:48.224 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:54:48.225 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:54:48.225 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:54:48.269 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:54:48.269 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:54:48.780 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:54:48.798 INFO:teuthology.orchestra.run.trial072.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:48.897 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:48.960 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:54:48.988 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librados2-debuginfo 2026-02-25T14:54:49.062 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:54:49.083 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:49.306 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:35:05 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:54:49.389 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout: librados2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 63 M 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:49.390 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 63 M 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 397 M 2026-02-25T14:54:49.391 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:54:51.067 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:51.086 INFO:teuthology.orchestra.run.trial031.stdout: Installing : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:51.445 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:51.509 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:51.545 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T14:54:51.863 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:05 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:51.946 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 646 k 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 646 k 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 2.3 M 2026-02-25T14:54:51.947 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:52.218 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout: ceph-test-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:54:52.282 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:54:52.481 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-base-debuginfo 2026-02-25T14:54:52.808 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:35:04 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:54:52.873 INFO:teuthology.orchestra.run.trial021.stdout:Package ceph-base-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 is already installed. 2026-02-25T14:54:52.891 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:54:52.892 INFO:teuthology.orchestra.run.trial021.stdout:Nothing to do. 2026-02-25T14:54:52.892 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:54:52.913 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mgr-debuginfo 2026-02-25T14:54:52.992 INFO:teuthology.orchestra.run.trial031.stdout:python3-cephfs-debuginfo-20.2.0-676.gc824a7fa.e 618 kB/s | 646 kB 00:01 2026-02-25T14:54:52.993 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:52.993 INFO:teuthology.orchestra.run.trial031.stdout:Total 617 kB/s | 646 kB 00:01 2026-02-25T14:54:52.993 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:52.995 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:52.995 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:53.015 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:53.015 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:53.081 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:53.099 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:53.162 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:53.226 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:54:53.226 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:53.227 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:53.227 INFO:teuthology.orchestra.run.trial031.stdout: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:53.227 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:53.227 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:53.234 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:35:05 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:54:53.252 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rados-debuginfo 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 22 M 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:54:53.317 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 22 M 2026-02-25T14:54:53.318 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 146 M 2026-02-25T14:54:53.318 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:54:53.570 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:07 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:53.652 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:53.652 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:53.652 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:53.652 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:53.652 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 800 k 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 800 k 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 3.1 M 2026-02-25T14:54:53.653 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:57.432 INFO:teuthology.orchestra.run.trial031.stdout:python3-rados-debuginfo-20.2.0-676.gc824a7fa.el 212 kB/s | 800 kB 00:03 2026-02-25T14:54:57.433 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:57.433 INFO:teuthology.orchestra.run.trial031.stdout:Total 212 kB/s | 800 kB 00:03 2026-02-25T14:54:57.433 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:54:57.435 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:54:57.435 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:54:57.456 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:54:57.456 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:54:57.530 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:54:57.548 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:54:57.612 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:54:57.676 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:54:57.676 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:57.676 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:54:57.676 INFO:teuthology.orchestra.run.trial031.stdout: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:54:57.677 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:57.677 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:54:57.701 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T14:54:58.015 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:12 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:54:58.098 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:54:58.098 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:58.098 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.2 M 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:54:58.099 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 1.2 M 2026-02-25T14:54:58.100 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 4.7 M 2026-02-25T14:54:58.100 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:54:59.879 INFO:teuthology.orchestra.run.trial021.stdout:ceph-mgr-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.3 MB/s | 22 MB 00:06 2026-02-25T14:54:59.880 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:54:59.880 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.3 MB/s | 22 MB 00:06 2026-02-25T14:54:59.880 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:54:59.882 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:54:59.882 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:54:59.964 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:54:59.964 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:55:00.971 INFO:teuthology.orchestra.run.trial031.stdout:python3-rbd-debuginfo-20.2.0-676.gc824a7fa.el9. 415 kB/s | 1.2 MB 00:02 2026-02-25T14:55:00.972 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:00.972 INFO:teuthology.orchestra.run.trial031.stdout:Total 415 kB/s | 1.2 MB 00:02 2026-02-25T14:55:00.972 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:55:00.974 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:55:00.974 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:55:00.995 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:55:00.995 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:55:01.088 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:55:01.105 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:01.170 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:01.234 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:01.235 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:01.235 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:55:01.235 INFO:teuthology.orchestra.run.trial031.stdout: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:01.235 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:01.235 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:55:01.237 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:55:01.256 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:01.261 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T14:55:01.424 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mgr-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:01.487 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:55:01.516 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mds-debuginfo 2026-02-25T14:55:01.577 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:15 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:55:01.660 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:55:01.660 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:01.660 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:55:01.660 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 350 k 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 350 k 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 1.1 M 2026-02-25T14:55:01.661 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:55:01.830 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:35:13 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 54 M 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:55:01.913 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:01.914 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 54 M 2026-02-25T14:55:01.914 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 221 M 2026-02-25T14:55:01.914 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:55:02.191 INFO:teuthology.orchestra.run.trial031.stdout:python3-rgw-debuginfo-20.2.0-676.gc824a7fa.el9. 661 kB/s | 350 kB 00:00 2026-02-25T14:55:02.192 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:02.192 INFO:teuthology.orchestra.run.trial031.stdout:Total 660 kB/s | 350 kB 00:00 2026-02-25T14:55:02.192 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:55:02.193 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:55:02.193 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:55:02.213 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:55:02.213 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:55:02.264 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:55:02.282 INFO:teuthology.orchestra.run.trial031.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:02.345 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:02.409 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:02.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:02.409 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:55:02.409 INFO:teuthology.orchestra.run.trial031.stdout: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:02.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:02.410 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:55:02.436 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T14:55:02.750 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:16 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.5 M 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 1.5 M 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 7.9 M 2026-02-25T14:55:02.834 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:55:04.003 INFO:teuthology.orchestra.run.trial031.stdout:rbd-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:55:04.004 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:04.004 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:55:04.004 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:55:04.006 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:55:04.006 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:55:04.029 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:55:04.030 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:55:04.146 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:55:04.164 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:04.232 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:04.297 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:04.297 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:04.297 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:55:04.297 INFO:teuthology.orchestra.run.trial031.stdout: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:04.297 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:04.298 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:55:04.324 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T14:55:04.642 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:18 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:55:04.726 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:55:04.727 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:04.727 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:55:04.727 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:04.727 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:55:04.727 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 79 M 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 79 M 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 375 M 2026-02-25T14:55:04.728 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:55:18.532 INFO:teuthology.orchestra.run.trial072.stdout:librados2-debuginfo-20.2.0-676.gc824a7fa.el9.x8 2.2 MB/s | 63 MB 00:29 2026-02-25T14:55:18.533 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:18.534 INFO:teuthology.orchestra.run.trial072.stdout:Total 2.2 MB/s | 63 MB 00:29 2026-02-25T14:55:18.534 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:18.535 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:18.535 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:18.741 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:18.742 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:20.090 INFO:teuthology.orchestra.run.trial021.stdout:ceph-mds-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.0 MB/s | 54 MB 00:18 2026-02-25T14:55:20.092 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:20.092 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.0 MB/s | 54 MB 00:18 2026-02-25T14:55:20.092 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:55:20.093 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:55:20.093 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:55:20.268 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:55:20.269 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:55:22.412 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:22.432 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:55:22.778 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:22.842 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:22.875 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install librbd1-debuginfo 2026-02-25T14:55:23.000 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:55:23.019 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:23.193 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:35:39 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:23.240 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:23.278 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout: librbd1-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 80 M 2026-02-25T14:55:23.279 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 80 M 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 406 M 2026-02-25T14:55:23.280 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mds-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:23.304 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:55:23.336 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-mon-debuginfo 2026-02-25T14:55:23.658 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:35:35 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:55:23.741 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:55:23.741 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 129 M 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 129 M 2026-02-25T14:55:23.742 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 641 M 2026-02-25T14:55:23.743 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:55:35.759 INFO:teuthology.orchestra.run.trial031.stdout:rbd-mirror-debuginfo-20.2.0-676.gc824a7fa.el9.x 2.6 MB/s | 79 MB 00:31 2026-02-25T14:55:35.760 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:35.760 INFO:teuthology.orchestra.run.trial031.stdout:Total 2.6 MB/s | 79 MB 00:31 2026-02-25T14:55:35.760 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:55:35.762 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:55:35.762 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:55:36.014 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:55:36.015 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:55:40.222 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:55:40.240 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:55:40.570 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:55:40.634 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:55:40.634 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:40.634 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:55:40.634 INFO:teuthology.orchestra.run.trial031.stdout: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:40.634 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:40.635 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:55:40.665 DEBUG:teuthology.orchestra.run.trial031:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T14:55:40.975 INFO:teuthology.orchestra.run.trial031.stdout:Last metadata expiration check: 0:35:54 ago on Wed 25 Feb 2026 02:19:46 PM UTC. 2026-02-25T14:55:41.058 INFO:teuthology.orchestra.run.trial031.stdout:Dependencies resolved. 2026-02-25T14:55:41.059 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:41.059 INFO:teuthology.orchestra.run.trial031.stdout: Package Arch Version Repo Size 2026-02-25T14:55:41.059 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:41.059 INFO:teuthology.orchestra.run.trial031.stdout:Installing: 2026-02-25T14:55:41.059 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.4 M 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:Transaction Summary 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:================================================================================ 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:Install 1 Package 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:Total download size: 2.4 M 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:Installed size: 12 M 2026-02-25T14:55:41.060 INFO:teuthology.orchestra.run.trial031.stdout:Downloading Packages: 2026-02-25T14:55:42.724 INFO:teuthology.orchestra.run.trial031.stdout:rbd-nbd-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 1.5 MB/s | 2.4 MB 00:01 2026-02-25T14:55:42.724 INFO:teuthology.orchestra.run.trial031.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:42.724 INFO:teuthology.orchestra.run.trial031.stdout:Total 1.5 MB/s | 2.4 MB 00:01 2026-02-25T14:55:42.724 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction check 2026-02-25T14:55:42.726 INFO:teuthology.orchestra.run.trial031.stdout:Transaction check succeeded. 2026-02-25T14:55:42.726 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction test 2026-02-25T14:55:42.751 INFO:teuthology.orchestra.run.trial031.stdout:Transaction test succeeded. 2026-02-25T14:55:42.751 INFO:teuthology.orchestra.run.trial031.stdout:Running transaction 2026-02-25T14:55:42.916 INFO:teuthology.orchestra.run.trial031.stdout: Preparing : 1/1 2026-02-25T14:55:42.934 INFO:teuthology.orchestra.run.trial031.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:43.004 INFO:teuthology.orchestra.run.trial031.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:43.068 INFO:teuthology.orchestra.run.trial031.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:43.068 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:43.068 INFO:teuthology.orchestra.run.trial031.stdout:Installed: 2026-02-25T14:55:43.068 INFO:teuthology.orchestra.run.trial031.stdout: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:43.068 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:55:43.069 INFO:teuthology.orchestra.run.trial031.stdout:Complete! 2026-02-25T14:55:43.100 DEBUG:teuthology.parallel:result is None 2026-02-25T14:55:48.878 INFO:teuthology.orchestra.run.trial072.stdout:librbd1-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 3.1 MB/s | 80 MB 00:25 2026-02-25T14:55:48.879 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:48.879 INFO:teuthology.orchestra.run.trial072.stdout:Total 3.1 MB/s | 80 MB 00:25 2026-02-25T14:55:48.879 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:48.881 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:48.881 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:49.139 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:49.139 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:53.451 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:53.470 INFO:teuthology.orchestra.run.trial072.stdout: Installing : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:53.826 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:53.889 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:55:53.889 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:53.889 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:53.890 INFO:teuthology.orchestra.run.trial072.stdout: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:53.890 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:53.890 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:53.924 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T14:55:54.242 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:10 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:54.325 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:54.325 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 646 k 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 646 k 2026-02-25T14:55:54.326 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 2.3 M 2026-02-25T14:55:54.327 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:55:55.127 INFO:teuthology.orchestra.run.trial072.stdout:python3-cephfs-debuginfo-20.2.0-676.gc824a7fa.e 806 kB/s | 646 kB 00:00 2026-02-25T14:55:55.127 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:55.128 INFO:teuthology.orchestra.run.trial072.stdout:Total 805 kB/s | 646 kB 00:00 2026-02-25T14:55:55.128 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:55.130 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:55.130 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:55.149 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:55.149 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:55.214 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:55.232 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:55:55.293 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:55.357 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:55.383 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rados-debuginfo 2026-02-25T14:55:55.698 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:11 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:55.780 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:55.781 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 800 k 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:55.782 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:55.783 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 800 k 2026-02-25T14:55:55.783 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 3.1 M 2026-02-25T14:55:55.783 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:55:56.531 INFO:teuthology.orchestra.run.trial072.stdout:python3-rados-debuginfo-20.2.0-676.gc824a7fa.el 1.0 MB/s | 800 kB 00:00 2026-02-25T14:55:56.531 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:56.531 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.0 MB/s | 800 kB 00:00 2026-02-25T14:55:56.531 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:56.533 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:56.533 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:56.553 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:56.553 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:56.627 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:56.645 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:55:56.710 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:56.773 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:56.801 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T14:55:57.113 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:13 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:57.197 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:57.198 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:57.198 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:57.198 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.2 M 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 1.2 M 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 4.7 M 2026-02-25T14:55:57.199 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:55:58.006 INFO:teuthology.orchestra.run.trial072.stdout:python3-rbd-debuginfo-20.2.0-676.gc824a7fa.el9. 1.4 MB/s | 1.2 MB 00:00 2026-02-25T14:55:58.006 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:58.006 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.4 MB/s | 1.2 MB 00:00 2026-02-25T14:55:58.006 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:58.008 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:58.008 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:58.029 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:58.029 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:58.121 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:58.139 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:58.204 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:58.267 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:58.267 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:58.267 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:58.267 INFO:teuthology.orchestra.run.trial072.stdout: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:58.268 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:58.268 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:58.296 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T14:55:58.613 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:14 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:58.696 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:58.696 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 350 k 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:58.697 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 350 k 2026-02-25T14:55:58.698 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 1.1 M 2026-02-25T14:55:58.698 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:55:59.192 INFO:teuthology.orchestra.run.trial072.stdout:python3-rgw-debuginfo-20.2.0-676.gc824a7fa.el9. 708 kB/s | 350 kB 00:00 2026-02-25T14:55:59.192 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:55:59.192 INFO:teuthology.orchestra.run.trial072.stdout:Total 707 kB/s | 350 kB 00:00 2026-02-25T14:55:59.192 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:55:59.194 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:55:59.194 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:55:59.212 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:55:59.213 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:55:59.263 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:55:59.281 INFO:teuthology.orchestra.run.trial072.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:59.341 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:59.404 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:55:59.404 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:59.404 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:55:59.404 INFO:teuthology.orchestra.run.trial072.stdout: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:55:59.405 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:59.405 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:55:59.431 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T14:55:59.750 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:15 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:55:59.833 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.5 M 2026-02-25T14:55:59.834 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 1.5 M 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 7.9 M 2026-02-25T14:55:59.835 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:56:00.830 INFO:teuthology.orchestra.run.trial072.stdout:rbd-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.5 MB/s | 1.5 MB 00:00 2026-02-25T14:56:00.831 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:56:00.831 INFO:teuthology.orchestra.run.trial072.stdout:Total 1.5 MB/s | 1.5 MB 00:00 2026-02-25T14:56:00.831 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:56:00.832 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:56:00.832 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:56:00.854 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:56:00.854 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:56:00.967 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:56:00.985 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:01.051 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:01.115 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:01.115 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:01.115 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:56:01.116 INFO:teuthology.orchestra.run.trial072.stdout: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:56:01.116 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:01.116 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:56:01.144 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T14:56:01.462 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:17 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:56:01.544 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:56:01.545 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:01.545 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 79 M 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 79 M 2026-02-25T14:56:01.546 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 375 M 2026-02-25T14:56:01.547 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:56:05.187 INFO:teuthology.orchestra.run.trial072.stdout:rbd-mirror-debuginfo-20.2.0-676.gc824a7fa.el9.x 22 MB/s | 79 MB 00:03 2026-02-25T14:56:05.188 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:56:05.188 INFO:teuthology.orchestra.run.trial072.stdout:Total 22 MB/s | 79 MB 00:03 2026-02-25T14:56:05.189 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:56:05.190 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:56:05.190 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:56:05.442 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:56:05.442 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:56:07.026 INFO:teuthology.orchestra.run.trial021.stdout:ceph-mon-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.0 MB/s | 129 MB 00:43 2026-02-25T14:56:07.027 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:56:07.027 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.0 MB/s | 129 MB 00:43 2026-02-25T14:56:07.027 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:56:07.029 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:56:07.029 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:56:07.425 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:56:07.426 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:56:09.487 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:56:09.505 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:56:09.850 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:56:09.914 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:56:09.914 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:09.914 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:56:09.914 INFO:teuthology.orchestra.run.trial072.stdout: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:56:09.914 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:09.915 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:56:09.948 DEBUG:teuthology.orchestra.run.trial072:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T14:56:10.263 INFO:teuthology.orchestra.run.trial072.stdout:Last metadata expiration check: 0:36:26 ago on Wed 25 Feb 2026 02:19:44 PM UTC. 2026-02-25T14:56:10.347 INFO:teuthology.orchestra.run.trial072.stdout:Dependencies resolved. 2026-02-25T14:56:10.348 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:10.348 INFO:teuthology.orchestra.run.trial072.stdout: Package Arch Version Repo Size 2026-02-25T14:56:10.348 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:10.348 INFO:teuthology.orchestra.run.trial072.stdout:Installing: 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.4 M 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:Transaction Summary 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:================================================================================ 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:Install 1 Package 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:Total download size: 2.4 M 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:Installed size: 12 M 2026-02-25T14:56:10.349 INFO:teuthology.orchestra.run.trial072.stdout:Downloading Packages: 2026-02-25T14:56:10.502 INFO:teuthology.orchestra.run.trial072.stdout:rbd-nbd-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 16 MB/s | 2.4 MB 00:00 2026-02-25T14:56:10.502 INFO:teuthology.orchestra.run.trial072.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:56:10.502 INFO:teuthology.orchestra.run.trial072.stdout:Total 16 MB/s | 2.4 MB 00:00 2026-02-25T14:56:10.502 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction check 2026-02-25T14:56:10.504 INFO:teuthology.orchestra.run.trial072.stdout:Transaction check succeeded. 2026-02-25T14:56:10.504 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction test 2026-02-25T14:56:10.528 INFO:teuthology.orchestra.run.trial072.stdout:Transaction test succeeded. 2026-02-25T14:56:10.528 INFO:teuthology.orchestra.run.trial072.stdout:Running transaction 2026-02-25T14:56:10.687 INFO:teuthology.orchestra.run.trial072.stdout: Preparing : 1/1 2026-02-25T14:56:10.705 INFO:teuthology.orchestra.run.trial072.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:10.773 INFO:teuthology.orchestra.run.trial072.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:10.836 INFO:teuthology.orchestra.run.trial072.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:10.837 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:10.837 INFO:teuthology.orchestra.run.trial072.stdout:Installed: 2026-02-25T14:56:10.837 INFO:teuthology.orchestra.run.trial072.stdout: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:56:10.837 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:56:10.837 INFO:teuthology.orchestra.run.trial072.stdout:Complete! 2026-02-25T14:56:10.868 DEBUG:teuthology.parallel:result is None 2026-02-25T14:56:14.056 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:56:14.075 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:14.608 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:14.670 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:56:14.671 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:56:14.671 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:56:14.671 INFO:teuthology.orchestra.run.trial021.stdout: ceph-mon-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:56:14.671 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:56:14.671 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:56:14.708 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-osd-debuginfo 2026-02-25T14:56:15.027 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:36:27 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:56:15.111 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 343 M 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:56:15.112 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:56:15.113 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:56:15.113 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:56:15.113 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 343 M 2026-02-25T14:56:15.113 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 1.6 G 2026-02-25T14:56:15.113 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:57:55.408 INFO:teuthology.orchestra.run.trial021.stdout:ceph-osd-debuginfo-20.2.0-676.gc824a7fa.el9.x86 3.4 MB/s | 343 MB 01:40 2026-02-25T14:57:55.409 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:57:55.409 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.4 MB/s | 343 MB 01:40 2026-02-25T14:57:55.409 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:57:55.411 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:57:55.411 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:57:56.434 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:57:56.434 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:58:13.958 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:58:13.977 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:58:15.209 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:58:15.271 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:58:15.271 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:15.271 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:58:15.272 INFO:teuthology.orchestra.run.trial021.stdout: ceph-osd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:58:15.272 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:15.272 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:58:15.326 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install ceph-fuse-debuginfo 2026-02-25T14:58:15.638 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:38:27 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:58:15.721 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 10 M 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:58:15.722 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:15.723 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:58:15.723 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:15.723 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 10 M 2026-02-25T14:58:15.723 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 51 M 2026-02-25T14:58:15.723 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:58:19.301 INFO:teuthology.orchestra.run.trial021.stdout:ceph-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x8 2.8 MB/s | 10 MB 00:03 2026-02-25T14:58:19.302 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:58:19.303 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.8 MB/s | 10 MB 00:03 2026-02-25T14:58:19.303 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:58:19.304 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:58:19.304 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:58:19.350 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:58:19.351 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:58:19.905 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:58:19.923 INFO:teuthology.orchestra.run.trial021.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:20.020 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:20.083 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:20.084 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:20.084 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:58:20.084 INFO:teuthology.orchestra.run.trial021.stdout: ceph-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:58:20.084 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:20.084 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:58:20.110 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librados-devel-debuginfo 2026-02-25T14:58:20.427 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:38:32 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:58:20.510 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout: librados-devel-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 144 k 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 144 k 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 802 k 2026-02-25T14:58:20.511 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:58:20.998 INFO:teuthology.orchestra.run.trial021.stdout:librados-devel-debuginfo-20.2.0-676.gc824a7fa.e 295 kB/s | 144 kB 00:00 2026-02-25T14:58:20.998 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:58:20.999 INFO:teuthology.orchestra.run.trial021.stdout:Total 294 kB/s | 144 kB 00:00 2026-02-25T14:58:20.999 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:58:21.001 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:58:21.001 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:58:21.020 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:58:21.020 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:58:21.062 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:58:21.080 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:58:21.143 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout: librados-devel-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:21.206 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:58:21.233 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install libcephfs2-debuginfo 2026-02-25T14:58:21.548 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:38:33 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 9.1 M 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:58:21.631 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:21.632 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 9.1 M 2026-02-25T14:58:21.632 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 46 M 2026-02-25T14:58:21.632 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:58:23.678 INFO:teuthology.orchestra.run.trial021.stdout:libcephfs2-debuginfo-20.2.0-676.gc824a7fa.el9.x 4.4 MB/s | 9.1 MB 00:02 2026-02-25T14:58:23.679 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:58:23.679 INFO:teuthology.orchestra.run.trial021.stdout:Total 4.4 MB/s | 9.1 MB 00:02 2026-02-25T14:58:23.680 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:58:23.681 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:58:23.681 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:58:23.725 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:58:23.725 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:58:24.221 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:58:24.239 INFO:teuthology.orchestra.run.trial021.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:58:24.333 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:58:24.395 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:58:24.395 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:24.396 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:58:24.396 INFO:teuthology.orchestra.run.trial021.stdout: libcephfs2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:58:24.396 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:24.396 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:58:24.422 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librados2-debuginfo 2026-02-25T14:58:24.735 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:38:36 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:58:24.818 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:58:24.819 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:24.819 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:58:24.819 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:24.819 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout: librados2-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 63 M 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 63 M 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 397 M 2026-02-25T14:58:24.820 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:58:30.202 INFO:teuthology.orchestra.run.trial021.stdout:librados2-debuginfo-20.2.0-676.gc824a7fa.el9.x8 12 MB/s | 63 MB 00:05 2026-02-25T14:58:30.203 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:58:30.203 INFO:teuthology.orchestra.run.trial021.stdout:Total 12 MB/s | 63 MB 00:05 2026-02-25T14:58:30.203 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:58:30.204 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:58:30.205 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:58:30.410 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:58:30.410 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:58:33.908 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:58:33.927 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:34.284 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:34.346 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_6 1/1 2026-02-25T14:58:34.346 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:34.346 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:58:34.346 INFO:teuthology.orchestra.run.trial021.stdout: librados2-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:58:34.347 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:34.347 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:58:34.378 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install librbd1-debuginfo 2026-02-25T14:58:34.694 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:38:46 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:58:34.778 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:58:34.778 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:34.778 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:58:34.778 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout: librbd1-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 80 M 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 80 M 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 406 M 2026-02-25T14:58:34.779 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:04.912 INFO:teuthology.orchestra.run.trial021.stdout:librbd1-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 2.7 MB/s | 80 MB 00:30 2026-02-25T14:59:04.912 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:04.913 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.7 MB/s | 80 MB 00:30 2026-02-25T14:59:04.913 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:04.915 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:04.915 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:05.171 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:05.172 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:09.415 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:09.433 INFO:teuthology.orchestra.run.trial021.stdout: Installing : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:09.783 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:09.846 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:09.847 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:09.847 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:09.847 INFO:teuthology.orchestra.run.trial021.stdout: librbd1-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:09.847 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:09.847 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:09.882 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-cephfs-debuginfo 2026-02-25T14:59:10.200 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:22 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:10.282 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:10.283 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 646 k 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:10.284 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 646 k 2026-02-25T14:59:10.285 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 2.3 M 2026-02-25T14:59:10.285 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:10.853 INFO:teuthology.orchestra.run.trial021.stdout:python3-cephfs-debuginfo-20.2.0-676.gc824a7fa.e 1.1 MB/s | 646 kB 00:00 2026-02-25T14:59:10.853 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:10.853 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.1 MB/s | 646 kB 00:00 2026-02-25T14:59:10.854 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:10.855 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:10.855 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:10.874 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:10.874 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:10.939 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:10.957 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:59:11.019 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:59:11.081 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9. 1/1 2026-02-25T14:59:11.081 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:11.081 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:11.082 INFO:teuthology.orchestra.run.trial021.stdout: python3-cephfs-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:11.082 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:11.082 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:11.108 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rados-debuginfo 2026-02-25T14:59:11.424 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:23 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:11.507 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout: python3-rados-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 800 k 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:11.508 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:11.509 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 800 k 2026-02-25T14:59:11.509 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 3.1 M 2026-02-25T14:59:11.509 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:12.254 INFO:teuthology.orchestra.run.trial021.stdout:python3-rados-debuginfo-20.2.0-676.gc824a7fa.el 1.0 MB/s | 800 kB 00:00 2026-02-25T14:59:12.255 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:12.255 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.0 MB/s | 800 kB 00:00 2026-02-25T14:59:12.255 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:12.257 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:12.257 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:12.276 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:12.277 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:12.350 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:12.369 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:59:12.430 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x 1/1 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout: python3-rados-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:12.494 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:12.520 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rbd-debuginfo 2026-02-25T14:59:12.836 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:24 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:12.919 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.2 M 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:12.920 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:12.921 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:12.921 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:12.921 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 1.2 M 2026-02-25T14:59:12.921 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 4.7 M 2026-02-25T14:59:12.921 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:13.721 INFO:teuthology.orchestra.run.trial021.stdout:python3-rbd-debuginfo-20.2.0-676.gc824a7fa.el9. 1.5 MB/s | 1.2 MB 00:00 2026-02-25T14:59:13.721 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:13.721 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.5 MB/s | 1.2 MB 00:00 2026-02-25T14:59:13.721 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:13.723 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:13.723 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:13.744 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:13.744 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:13.836 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:13.853 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:13.917 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout: python3-rbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:13.980 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:14.006 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install python3-rgw-debuginfo 2026-02-25T14:59:14.322 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:26 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:14.406 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:14.407 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:14.407 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:14.407 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 350 k 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:14.408 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:14.409 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:14.409 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 350 k 2026-02-25T14:59:14.409 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 1.1 M 2026-02-25T14:59:14.409 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:15.025 INFO:teuthology.orchestra.run.trial021.stdout:python3-rgw-debuginfo-20.2.0-676.gc824a7fa.el9. 567 kB/s | 350 kB 00:00 2026-02-25T14:59:15.025 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:15.026 INFO:teuthology.orchestra.run.trial021.stdout:Total 566 kB/s | 350 kB 00:00 2026-02-25T14:59:15.026 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:15.027 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:15.028 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:15.046 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:15.046 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:15.096 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:15.115 INFO:teuthology.orchestra.run.trial021.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:15.180 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86 1/1 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout: python3-rgw-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:15.244 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:15.271 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-fuse-debuginfo 2026-02-25T14:59:15.589 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:27 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:15.672 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:15.672 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 1.5 M 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:15.673 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:15.674 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 1.5 M 2026-02-25T14:59:15.674 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 7.9 M 2026-02-25T14:59:15.674 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:16.848 INFO:teuthology.orchestra.run.trial021.stdout:rbd-fuse-debuginfo-20.2.0-676.gc824a7fa.el9.x86 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:59:16.848 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:16.848 INFO:teuthology.orchestra.run.trial021.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-25T14:59:16.848 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:16.850 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:16.850 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:16.871 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:16.872 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:16.984 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:17.003 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:17.069 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout: rbd-fuse-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:17.132 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:17.159 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-mirror-debuginfo 2026-02-25T14:59:17.475 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:29 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:17.558 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 79 M 2026-02-25T14:59:17.559 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 79 M 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 375 M 2026-02-25T14:59:17.560 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:38.138 INFO:teuthology.orchestra.run.trial021.stdout:rbd-mirror-debuginfo-20.2.0-676.gc824a7fa.el9.x 3.9 MB/s | 79 MB 00:20 2026-02-25T14:59:38.139 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:38.139 INFO:teuthology.orchestra.run.trial021.stdout:Total 3.9 MB/s | 79 MB 00:20 2026-02-25T14:59:38.139 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:38.141 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:38.141 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:38.391 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:38.391 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:42.437 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:42.455 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:59:42.788 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:59:42.851 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_ 1/1 2026-02-25T14:59:42.851 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:42.851 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:42.851 INFO:teuthology.orchestra.run.trial021.stdout: rbd-mirror-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:42.851 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:42.852 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:42.883 DEBUG:teuthology.orchestra.run.trial021:> sudo yum -y install rbd-nbd-debuginfo 2026-02-25T14:59:43.199 INFO:teuthology.orchestra.run.trial021.stdout:Last metadata expiration check: 0:39:55 ago on Wed 25 Feb 2026 02:19:48 PM UTC. 2026-02-25T14:59:43.282 INFO:teuthology.orchestra.run.trial021.stdout:Dependencies resolved. 2026-02-25T14:59:43.283 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:43.283 INFO:teuthology.orchestra.run.trial021.stdout: Package Arch Version Repo Size 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:Installing: 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-676.gc824a7fa.el9 ceph 2.4 M 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:Transaction Summary 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:================================================================================ 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:Install 1 Package 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:Total download size: 2.4 M 2026-02-25T14:59:43.284 INFO:teuthology.orchestra.run.trial021.stdout:Installed size: 12 M 2026-02-25T14:59:43.285 INFO:teuthology.orchestra.run.trial021.stdout:Downloading Packages: 2026-02-25T14:59:44.227 INFO:teuthology.orchestra.run.trial021.stdout:rbd-nbd-debuginfo-20.2.0-676.gc824a7fa.el9.x86_ 2.6 MB/s | 2.4 MB 00:00 2026-02-25T14:59:44.228 INFO:teuthology.orchestra.run.trial021.stdout:-------------------------------------------------------------------------------- 2026-02-25T14:59:44.228 INFO:teuthology.orchestra.run.trial021.stdout:Total 2.6 MB/s | 2.4 MB 00:00 2026-02-25T14:59:44.228 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction check 2026-02-25T14:59:44.229 INFO:teuthology.orchestra.run.trial021.stdout:Transaction check succeeded. 2026-02-25T14:59:44.230 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction test 2026-02-25T14:59:44.253 INFO:teuthology.orchestra.run.trial021.stdout:Transaction test succeeded. 2026-02-25T14:59:44.254 INFO:teuthology.orchestra.run.trial021.stdout:Running transaction 2026-02-25T14:59:44.415 INFO:teuthology.orchestra.run.trial021.stdout: Preparing : 1/1 2026-02-25T14:59:44.433 INFO:teuthology.orchestra.run.trial021.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:44.502 INFO:teuthology.orchestra.run.trial021.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 1/1 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout:Installed: 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout: rbd-nbd-debuginfo-2:20.2.0-676.gc824a7fa.el9.x86_64 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:44.565 INFO:teuthology.orchestra.run.trial021.stdout:Complete! 2026-02-25T14:59:44.597 DEBUG:teuthology.parallel:result is None 2026-02-25T14:59:44.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:59:44.779 DEBUG:teuthology.orchestra.run.trial021:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T14:59:44.800 INFO:teuthology.orchestra.run.trial021.stdout:20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:44.801 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:44.801 INFO:teuthology.task.install:The correct ceph version 20.2.0-676.gc824a7fa is installed. 2026-02-25T14:59:44.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:59:44.958 DEBUG:teuthology.orchestra.run.trial031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T14:59:44.990 INFO:teuthology.orchestra.run.trial031.stdout:20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:44.991 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:44.991 INFO:teuthology.task.install:The correct ceph version 20.2.0-676.gc824a7fa is installed. 2026-02-25T14:59:44.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:59:45.153 DEBUG:teuthology.orchestra.run.trial068:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T14:59:45.185 INFO:teuthology.orchestra.run.trial068.stdout:20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:45.186 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:45.186 INFO:teuthology.task.install:The correct ceph version 20.2.0-676.gc824a7fa is installed. 2026-02-25T14:59:45.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T14:59:45.352 DEBUG:teuthology.orchestra.run.trial072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T14:59:45.385 INFO:teuthology.orchestra.run.trial072.stdout:20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:45.386 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-676.gc824a7fa.el9 2026-02-25T14:59:45.386 INFO:teuthology.task.install:The correct ceph version 20.2.0-676.gc824a7fa is installed. 2026-02-25T14:59:45.389 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-25T14:59:45.389 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:45.389 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T14:59:45.415 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:45.415 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T14:59:45.442 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:45.443 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T14:59:45.469 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:45.469 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T14:59:45.494 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-25T14:59:45.495 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:45.495 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T14:59:45.521 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T14:59:45.584 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:45.585 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T14:59:45.612 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T14:59:45.676 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:45.676 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T14:59:45.700 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T14:59:45.765 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:45.765 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T14:59:45.791 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T14:59:45.855 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-25T14:59:45.855 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:45.856 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T14:59:45.879 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T14:59:45.944 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:45.944 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T14:59:45.971 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T14:59:46.034 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:46.034 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T14:59:46.060 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T14:59:46.124 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:46.124 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T14:59:46.149 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T14:59:46.211 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-25T14:59:46.211 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:46.211 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T14:59:46.236 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T14:59:46.300 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:46.300 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T14:59:46.326 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T14:59:46.389 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:46.389 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T14:59:46.415 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T14:59:46.479 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:46.479 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T14:59:46.505 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T14:59:46.568 INFO:teuthology.run_tasks:Running task ceph... 2026-02-25T14:59:46.695 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-25T14:59:46.695 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod 777 /var/log/ceph 2026-02-25T14:59:46.700 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 777 /var/log/ceph 2026-02-25T14:59:46.702 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 777 /var/log/ceph 2026-02-25T14:59:46.703 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod 777 /var/log/ceph 2026-02-25T14:59:46.728 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-25T14:59:46.728 DEBUG:teuthology.orchestra.run.trial021:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T14:59:46.764 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T14:59:46.766 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T14:59:46.768 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T14:59:46.792 INFO:tasks.ceph:Creating extra log directories... 2026-02-25T14:59:46.792 DEBUG:teuthology.orchestra.run.trial021:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T14:59:46.827 DEBUG:teuthology.orchestra.run.trial031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T14:59:46.830 DEBUG:teuthology.orchestra.run.trial068:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T14:59:46.833 DEBUG:teuthology.orchestra.run.trial072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T14:59:46.878 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-25T14:59:46.879 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-25T14:59:46.879 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208', 'branch': 'tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '70208', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'tentacle', 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6877, 'sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_c824a7fa29b067db9ce5a381f59b175918299919/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'c824a7fa29b067db9ce5a381f59b175918299919', 'targets': {'trial021.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJKDiHqE8h7zDRlDhGvguFwV2xxLr2qcI5ye5jHTyo2av1mwLPh4UJKUNatzvJGDVBUNjd3kanPAkY5XraKcIRI=', 'trial031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF8V4mEb0lNTSmJuEx8LceOK8l1ARJNkDRRlFlecSI+WJLMKcgf0l9aYMh49iIGa2w8eLY4JdmCmU1fX+0hADTg=', 'trial068.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAnyZjgPEZSUMmOzmFgYB57Z5dXx7pNQ9iRdScMLednxk8gm4/sop3O+gVwpk4uFnOqZxHwHtKF9Pf1Gg57yq0=', 'trial072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOAkVK14dR8nY/gEe3167ZtfexVPxkGtJ4J2JxyHANNsBK2MV7okKgsXl9hJyeBGmPWU4eyxow0R+NRIKqRWQWE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-25_14:08:21', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-25T14:59:46.880 DEBUG:teuthology.orchestra.run.trial021:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T14:59:46.893 DEBUG:teuthology.orchestra.run.trial031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T14:59:46.896 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T14:59:46.898 DEBUG:teuthology.orchestra.run.trial072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T14:59:46.914 DEBUG:teuthology.orchestra.run.trial021:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T14:59:46.949 DEBUG:teuthology.orchestra.run.trial031:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T14:59:46.952 DEBUG:teuthology.orchestra.run.trial068:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T14:59:46.955 DEBUG:teuthology.orchestra.run.trial072:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T14:59:46.979 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:46.979 DEBUG:teuthology.orchestra.run.trial021:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T14:59:47.027 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T14:59:47.027 DEBUG:teuthology.orchestra.run.trial021:> stat /dev/vg_nvme/lv_1 2026-02-25T14:59:47.082 INFO:teuthology.orchestra.run.trial021.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Access: 2026-02-25 14:20:54.603237842 +0000 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Modify: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.083 INFO:teuthology.orchestra.run.trial021.stdout:Change: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.084 INFO:teuthology.orchestra.run.trial021.stdout: Birth: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.084 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T14:59:47.144 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records in 2026-02-25T14:59:47.145 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records out 2026-02-25T14:59:47.145 INFO:teuthology.orchestra.run.trial021.stderr:512 bytes copied, 0.000168051 s, 3.0 MB/s 2026-02-25T14:59:47.146 DEBUG:teuthology.orchestra.run.trial021:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T14:59:47.205 DEBUG:teuthology.orchestra.run.trial021:> stat /dev/vg_nvme/lv_2 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Access: 2026-02-25 14:20:54.604237828 +0000 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Modify: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout:Change: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.261 INFO:teuthology.orchestra.run.trial021.stdout: Birth: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.262 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T14:59:47.322 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records in 2026-02-25T14:59:47.322 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records out 2026-02-25T14:59:47.323 INFO:teuthology.orchestra.run.trial021.stderr:512 bytes copied, 0.000139278 s, 3.7 MB/s 2026-02-25T14:59:47.324 DEBUG:teuthology.orchestra.run.trial021:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T14:59:47.380 DEBUG:teuthology.orchestra.run.trial021:> stat /dev/vg_nvme/lv_3 2026-02-25T14:59:47.436 INFO:teuthology.orchestra.run.trial021.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T14:59:47.436 INFO:teuthology.orchestra.run.trial021.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Access: 2026-02-25 14:20:54.604237828 +0000 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Modify: 2026-02-25 14:19:57.191318920 +0000 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout:Change: 2026-02-25 14:19:57.191318920 +0000 2026-02-25T14:59:47.437 INFO:teuthology.orchestra.run.trial021.stdout: Birth: 2026-02-25 14:19:57.191318920 +0000 2026-02-25T14:59:47.437 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T14:59:47.499 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records in 2026-02-25T14:59:47.499 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records out 2026-02-25T14:59:47.499 INFO:teuthology.orchestra.run.trial021.stderr:512 bytes copied, 0.000161819 s, 3.2 MB/s 2026-02-25T14:59:47.501 DEBUG:teuthology.orchestra.run.trial021:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T14:59:47.557 DEBUG:teuthology.orchestra.run.trial021:> stat /dev/vg_nvme/lv_4 2026-02-25T14:59:47.613 INFO:teuthology.orchestra.run.trial021.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T14:59:47.613 INFO:teuthology.orchestra.run.trial021.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.613 INFO:teuthology.orchestra.run.trial021.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout:Access: 2026-02-25 14:20:54.604237828 +0000 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout:Modify: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout:Change: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.614 INFO:teuthology.orchestra.run.trial021.stdout: Birth: 2026-02-25 14:19:57.190318940 +0000 2026-02-25T14:59:47.614 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T14:59:47.676 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records in 2026-02-25T14:59:47.676 INFO:teuthology.orchestra.run.trial021.stderr:1+0 records out 2026-02-25T14:59:47.676 INFO:teuthology.orchestra.run.trial021.stderr:512 bytes copied, 0.000133356 s, 3.8 MB/s 2026-02-25T14:59:47.678 DEBUG:teuthology.orchestra.run.trial021:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T14:59:47.734 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:47.735 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:47.735 DEBUG:teuthology.orchestra.run.trial031:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T14:59:47.753 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T14:59:47.753 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_1 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-25 14:20:42.719267799 +0000 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-25 14:19:52.020253875 +0000 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-25 14:19:52.020253875 +0000 2026-02-25T14:59:47.810 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-25 14:19:52.020253875 +0000 2026-02-25T14:59:47.811 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T14:59:47.872 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-25T14:59:47.872 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-25T14:59:47.872 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000152834 s, 3.4 MB/s 2026-02-25T14:59:47.873 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T14:59:47.930 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_2 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:47.987 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-25 14:20:42.719267799 +0000 2026-02-25T14:59:47.988 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:47.988 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:47.988 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:47.988 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T14:59:48.050 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-25T14:59:48.050 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-25T14:59:48.050 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000151892 s, 3.4 MB/s 2026-02-25T14:59:48.051 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T14:59:48.108 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_3 2026-02-25T14:59:48.164 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-25 14:20:42.720267779 +0000 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.165 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.166 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T14:59:48.228 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-25T14:59:48.228 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-25T14:59:48.228 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000144959 s, 3.5 MB/s 2026-02-25T14:59:48.229 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T14:59:48.286 DEBUG:teuthology.orchestra.run.trial031:> stat /dev/vg_nvme/lv_4 2026-02-25T14:59:48.342 INFO:teuthology.orchestra.run.trial031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Access: 2026-02-25 14:20:42.720267779 +0000 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Modify: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout:Change: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.343 INFO:teuthology.orchestra.run.trial031.stdout: Birth: 2026-02-25 14:19:52.019253894 +0000 2026-02-25T14:59:48.344 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T14:59:48.405 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records in 2026-02-25T14:59:48.405 INFO:teuthology.orchestra.run.trial031.stderr:1+0 records out 2026-02-25T14:59:48.405 INFO:teuthology.orchestra.run.trial031.stderr:512 bytes copied, 0.000177219 s, 2.9 MB/s 2026-02-25T14:59:48.407 DEBUG:teuthology.orchestra.run.trial031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T14:59:48.463 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:48.464 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:48.464 DEBUG:teuthology.orchestra.run.trial068:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T14:59:48.482 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T14:59:48.483 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_1 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-25 14:20:48.139563332 +0000 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.539 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.539 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T14:59:48.600 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-25T14:59:48.600 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-25T14:59:48.600 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000151615 s, 3.4 MB/s 2026-02-25T14:59:48.601 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T14:59:48.658 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_2 2026-02-25T14:59:48.714 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 1287 Links: 1 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-25 14:20:48.140563405 +0000 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.715 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:48.715 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T14:59:48.777 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-25T14:59:48.777 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-25T14:59:48.777 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000145724 s, 3.5 MB/s 2026-02-25T14:59:48.778 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T14:59:48.835 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_3 2026-02-25T14:59:48.892 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T14:59:48.893 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:48.893 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-25T14:59:48.893 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:48.893 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:48.893 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-25 14:20:48.140563405 +0000 2026-02-25T14:59:48.894 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-25 14:19:58.042880002 +0000 2026-02-25T14:59:48.894 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-25 14:19:58.042880002 +0000 2026-02-25T14:59:48.894 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-25 14:19:58.042880002 +0000 2026-02-25T14:59:48.895 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T14:59:48.955 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-25T14:59:48.955 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-25T14:59:48.955 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000162295 s, 3.2 MB/s 2026-02-25T14:59:48.956 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T14:59:49.013 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_4 2026-02-25T14:59:49.069 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-25 14:20:48.140563405 +0000 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:49.070 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-25 14:19:58.041880018 +0000 2026-02-25T14:59:49.070 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T14:59:49.132 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-25T14:59:49.132 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-25T14:59:49.132 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.00013832 s, 3.7 MB/s 2026-02-25T14:59:49.133 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T14:59:49.191 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:49.191 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:49.191 DEBUG:teuthology.orchestra.run.trial072:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T14:59:49.210 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T14:59:49.210 DEBUG:teuthology.orchestra.run.trial072:> stat /dev/vg_nvme/lv_1 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:49.266 INFO:teuthology.orchestra.run.trial072.stdout:Access: 2026-02-25 14:20:51.392849139 +0000 2026-02-25T14:59:49.267 INFO:teuthology.orchestra.run.trial072.stdout:Modify: 2026-02-25 14:19:50.907123414 +0000 2026-02-25T14:59:49.267 INFO:teuthology.orchestra.run.trial072.stdout:Change: 2026-02-25 14:19:50.907123414 +0000 2026-02-25T14:59:49.267 INFO:teuthology.orchestra.run.trial072.stdout: Birth: 2026-02-25 14:19:50.907123414 +0000 2026-02-25T14:59:49.267 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T14:59:49.328 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records in 2026-02-25T14:59:49.329 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records out 2026-02-25T14:59:49.329 INFO:teuthology.orchestra.run.trial072.stderr:512 bytes copied, 0.000149711 s, 3.4 MB/s 2026-02-25T14:59:49.330 DEBUG:teuthology.orchestra.run.trial072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T14:59:49.386 DEBUG:teuthology.orchestra.run.trial072:> stat /dev/vg_nvme/lv_2 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Access: 2026-02-25 14:20:51.392849139 +0000 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Modify: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout:Change: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.442 INFO:teuthology.orchestra.run.trial072.stdout: Birth: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.442 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T14:59:49.504 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records in 2026-02-25T14:59:49.504 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records out 2026-02-25T14:59:49.504 INFO:teuthology.orchestra.run.trial072.stderr:512 bytes copied, 0.00014963 s, 3.4 MB/s 2026-02-25T14:59:49.505 DEBUG:teuthology.orchestra.run.trial072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T14:59:49.561 DEBUG:teuthology.orchestra.run.trial072:> stat /dev/vg_nvme/lv_3 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout:Device: 6h/6d Inode: 1285 Links: 1 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout:Access: 2026-02-25 14:20:51.392849139 +0000 2026-02-25T14:59:49.618 INFO:teuthology.orchestra.run.trial072.stdout:Modify: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.619 INFO:teuthology.orchestra.run.trial072.stdout:Change: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.619 INFO:teuthology.orchestra.run.trial072.stdout: Birth: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.619 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T14:59:49.680 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records in 2026-02-25T14:59:49.680 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records out 2026-02-25T14:59:49.680 INFO:teuthology.orchestra.run.trial072.stderr:512 bytes copied, 0.000146003 s, 3.5 MB/s 2026-02-25T14:59:49.681 DEBUG:teuthology.orchestra.run.trial072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T14:59:49.738 DEBUG:teuthology.orchestra.run.trial072:> stat /dev/vg_nvme/lv_4 2026-02-25T14:59:49.794 INFO:teuthology.orchestra.run.trial072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Access: 2026-02-25 14:20:51.393849135 +0000 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Modify: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout:Change: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.795 INFO:teuthology.orchestra.run.trial072.stdout: Birth: 2026-02-25 14:19:50.906123444 +0000 2026-02-25T14:59:49.796 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T14:59:49.857 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records in 2026-02-25T14:59:49.857 INFO:teuthology.orchestra.run.trial072.stderr:1+0 records out 2026-02-25T14:59:49.857 INFO:teuthology.orchestra.run.trial072.stderr:512 bytes copied, 0.000153257 s, 3.3 MB/s 2026-02-25T14:59:49.858 DEBUG:teuthology.orchestra.run.trial072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T14:59:49.915 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:49.915 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial021.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial031.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial068.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial072.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-25T14:59:49.916 INFO:tasks.ceph:Generating config... 2026-02-25T14:59:49.918 INFO:tasks.ceph:[client] debug monc = 20 2026-02-25T14:59:49.919 INFO:tasks.ceph:[client] debug ms = 1 2026-02-25T14:59:49.919 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-25T14:59:49.919 INFO:tasks.ceph:[client] debug rados = 20 2026-02-25T14:59:49.919 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] ms type = async 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-25T14:59:49.919 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-25T14:59:49.920 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-25T14:59:49.921 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-25T14:59:49.921 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-25T14:59:49.922 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-25T14:59:49.923 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-25T14:59:49.923 INFO:tasks.ceph:Setting up mon.a... 2026-02-25T14:59:49.924 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-25T14:59:49.959 INFO:teuthology.orchestra.run.trial021.stdout:creating /etc/ceph/ceph.keyring 2026-02-25T14:59:49.962 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-25T14:59:50.038 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T14:59:50.102 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.21:6789]'), ('mon.b', '[v1:10.20.193.31:6789]'), ('mon.c', '[v1:10.20.193.68:6789]')] 2026-02-25T14:59:50.103 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.21:6789],[v1:10.20.193.31:6789],[v1:10.20.193.68:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-25T14:59:50.105 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:50.105 DEBUG:teuthology.orchestra.run.trial021:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T14:59:50.158 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.21:6789]' --addv b '[v1:10.20.193.31:6789]' --addv c '[v1:10.20.193.68:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:50.232 INFO:teuthology.orchestra.run.trial021.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:50.232 INFO:teuthology.orchestra.run.trial021.stdout:monmaptool: generated fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.232 INFO:teuthology.orchestra.run.trial021.stdout:setting min_mon_release = tentacle 2026-02-25T14:59:50.232 INFO:teuthology.orchestra.run.trial021.stdout:epoch 0 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:created 2026-02-25T14:59:50.231561+0000 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:min_mon_release 20 (tentacle) 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:election_strategy: 3 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T14:59:50.233 INFO:teuthology.orchestra.run.trial021.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-25T14:59:50.235 DEBUG:teuthology.orchestra.run.trial021:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T14:59:50.290 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c... 2026-02-25T14:59:50.292 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T14:59:50.332 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T14:59:50.335 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T14:59:50.338 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T14:59:50.368 INFO:teuthology.orchestra.run.trial021.stdout:[global] 2026-02-25T14:59:50.368 INFO:teuthology.orchestra.run.trial021.stdout: chdir = "" 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: auth supported = cephx 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: filestore xattr use omap = true 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: mon clock drift allowed = 1.000 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: osd crush chooseleaf type = 0 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: auth debug = true 2026-02-25T14:59:50.369 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: ms die on old message = true 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: ms die on bug = true 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: mon pg warn max object skew = 0 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: osd pool default size = 2 2026-02-25T14:59:50.370 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon osd allow primary affinity = true 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon osd allow pg remap = true 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on legacy crush tunables = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on crush straw calc version zero = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on no sortbitwise = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on osd down out interval zero = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on too few osds = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: mon_allow_pool_size_one = true 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.371 INFO:teuthology.orchestra.run.trial021.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: osd default data pool replay window = 5 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon allow pool delete = true 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon cluster log file level = debug 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: debug asserts on shutdown = true 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon health detail to clog = false 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon host = "[v1:10.20.193.21:6789],[v1:10.20.193.31:6789],[v1:10.20.193.68:6789]" 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon client directed command retry = 5 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: mon election default strategy = 3 2026-02-25T14:59:50.372 INFO:teuthology.orchestra.run.trial021.stdout: ms bind msgr2 = False 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: ms inject socket failures = 5000 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: ms type = async 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd heartbeat grace = 160 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd op thread timeout = 150 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: fsid = 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout:[osd] 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd journal size = 100 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd scrub load threshold = 5.0 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd scrub max interval = 600 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd mclock profile = high_recovery_ops 2026-02-25T14:59:50.373 INFO:teuthology.orchestra.run.trial021.stdout: osd mclock skip benchmark = True 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd recover clone overlap = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd recovery max chunk = 1048576 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd debug shutdown = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd debug op order = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd debug verify stray on activate = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd debug trim objects = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd open classes on start = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: osd debug pg log writeout = true 2026-02-25T14:59:50.374 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: osd deep scrub update digest min age = 30 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: osd map max advance = 10 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: journal zero on create = true 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: filestore ondisk finisher threads = 3 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: filestore apply finisher threads = 3 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: bdev debug aio = true 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: osd debug misdirected ops = true 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: bdev async discard = True 2026-02-25T14:59:50.375 INFO:teuthology.orchestra.run.trial021.stdout: bdev enable discard = True 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore allocator = btree 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore block size = 96636764160 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore fsck on mount = True 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore onode segment size = 0 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore write v2 random = True 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: bluestore zero block detection = True 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: crush location = root=default host=host-$id 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug bluefs = 1 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug bluestore = 1 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug monc = 20 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug ms = 1 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug osd = 20 2026-02-25T14:59:50.376 INFO:teuthology.orchestra.run.trial021.stdout: debug rocksdb = 10 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: mon osd full ratio = 0.9 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: mon osd nearfull ratio = 0.8 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd class default list = * 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd class load list = * 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd client watch timeout = 240 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd debug verify cached snaps = True 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd debug verify missing on start = True 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd failsafe full ratio = 0.95 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd fast shutdown = False 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd mclock override recovery settings = True 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd objectstore = bluestore 2026-02-25T14:59:50.377 INFO:teuthology.orchestra.run.trial021.stdout: osd op queue = debug_random 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: osd op queue cut off = debug_random 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: osd shutdown pgref assert = True 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout:[mgr] 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: debug ms = 1 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: debug mgr = 20 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: debug mon = 20 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: debug auth = 20 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: mgr/telemetry/nag = false 2026-02-25T14:59:50.378 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout:[mon] 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: debug ms = 1 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: debug mon = 20 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: debug paxos = 20 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: debug auth = 20 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon data avail warn = 5 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon mgr mkfs grace = 240 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon osd reporter subtree level = osd 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon osd prime pg temp = true 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.379 INFO:teuthology.orchestra.run.trial021.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: # 1m isn't quite enough 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon_down_mkfs_grace = 2m 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon_warn_on_filestore_osds = false 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon min osdmap epochs = 50 2026-02-25T14:59:50.380 INFO:teuthology.orchestra.run.trial021.stdout: mon osd crush smoke test = False 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: mon osdmap full prune interval = 2 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: mon osdmap full prune min = 15 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: mon osdmap full prune txsize = 2 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: mon scrub interval = 300 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: mon warn on pool no app = False 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: paxos service trim min = 10 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout:[client] 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: rgw cache enabled = true 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: rgw enable ops log = true 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: rgw enable usage log = true 2026-02-25T14:59:50.381 INFO:teuthology.orchestra.run.trial021.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: debug monc = 20 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: debug ms = 1 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: debug objecter = 20 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: debug rados = 20 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout: rados replica read policy = balance 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout:[mon.a] 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout:[mon.b] 2026-02-25T14:59:50.382 INFO:teuthology.orchestra.run.trial021.stdout:[mon.c] 2026-02-25T14:59:50.383 INFO:teuthology.orchestra.run.trial072.stdout:[global] 2026-02-25T14:59:50.383 INFO:teuthology.orchestra.run.trial072.stdout: chdir = "" 2026-02-25T14:59:50.383 INFO:teuthology.orchestra.run.trial072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: auth supported = cephx 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: filestore xattr use omap = true 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: mon clock drift allowed = 1.000 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: osd crush chooseleaf type = 0 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: auth debug = true 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: ms die on old message = true 2026-02-25T14:59:50.384 INFO:teuthology.orchestra.run.trial072.stdout: ms die on bug = true 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: mon pg warn max object skew = 0 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: osd pool default size = 2 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: mon osd allow primary affinity = true 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: mon osd allow pg remap = true 2026-02-25T14:59:50.385 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on legacy crush tunables = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on crush straw calc version zero = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on no sortbitwise = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on osd down out interval zero = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on too few osds = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: mon_allow_pool_size_one = true 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: osd default data pool replay window = 5 2026-02-25T14:59:50.386 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon allow pool delete = true 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon cluster log file level = debug 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: debug asserts on shutdown = true 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon health detail to clog = false 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon host = "[v1:10.20.193.21:6789],[v1:10.20.193.31:6789],[v1:10.20.193.68:6789]" 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon client directed command retry = 5 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: mon election default strategy = 3 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: ms bind msgr2 = False 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: ms inject socket failures = 5000 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: ms type = async 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: osd heartbeat grace = 160 2026-02-25T14:59:50.387 INFO:teuthology.orchestra.run.trial072.stdout: osd op thread timeout = 150 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: fsid = 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout:[osd] 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd journal size = 100 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd scrub load threshold = 5.0 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd scrub max interval = 600 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd mclock profile = high_recovery_ops 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd mclock skip benchmark = True 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd recover clone overlap = true 2026-02-25T14:59:50.388 INFO:teuthology.orchestra.run.trial072.stdout: osd recovery max chunk = 1048576 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd debug shutdown = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd debug op order = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd debug verify stray on activate = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd debug trim objects = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd open classes on start = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd debug pg log writeout = true 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd deep scrub update digest min age = 30 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: osd map max advance = 10 2026-02-25T14:59:50.389 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: journal zero on create = true 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: filestore ondisk finisher threads = 3 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: filestore apply finisher threads = 3 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bdev debug aio = true 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: osd debug misdirected ops = true 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bdev async discard = True 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bdev enable discard = True 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bluestore allocator = btree 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bluestore block size = 96636764160 2026-02-25T14:59:50.390 INFO:teuthology.orchestra.run.trial072.stdout: bluestore fsck on mount = True 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: bluestore onode segment size = 0 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: bluestore write v2 random = True 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: bluestore zero block detection = True 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: crush location = root=default host=host-$id 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug bluefs = 1 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug bluestore = 1 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug monc = 20 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug ms = 1 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug osd = 20 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: debug rocksdb = 10 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: mon osd full ratio = 0.9 2026-02-25T14:59:50.391 INFO:teuthology.orchestra.run.trial072.stdout: mon osd nearfull ratio = 0.8 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd class default list = * 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd class load list = * 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd client watch timeout = 240 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd debug verify cached snaps = True 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd debug verify missing on start = True 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd failsafe full ratio = 0.95 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd fast shutdown = False 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd mclock override recovery settings = True 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd objectstore = bluestore 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd op queue = debug_random 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd op queue cut off = debug_random 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: osd shutdown pgref assert = True 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.392 INFO:teuthology.orchestra.run.trial072.stdout:[mgr] 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug ms = 1 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug mgr = 20 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug mon = 20 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug auth = 20 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: mgr/telemetry/nag = false 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout:[mon] 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug ms = 1 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug mon = 20 2026-02-25T14:59:50.393 INFO:teuthology.orchestra.run.trial072.stdout: debug paxos = 20 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: debug auth = 20 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon data avail warn = 5 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon mgr mkfs grace = 240 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon osd reporter subtree level = osd 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon osd prime pg temp = true 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.394 INFO:teuthology.orchestra.run.trial072.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: # 1m isn't quite enough 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon_down_mkfs_grace = 2m 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon_warn_on_filestore_osds = false 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon min osdmap epochs = 50 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon osd crush smoke test = False 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon osdmap full prune interval = 2 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon osdmap full prune min = 15 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon osdmap full prune txsize = 2 2026-02-25T14:59:50.395 INFO:teuthology.orchestra.run.trial072.stdout: mon scrub interval = 300 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: mon warn on pool no app = False 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: paxos service trim min = 10 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout:[client] 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: rgw cache enabled = true 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: rgw enable ops log = true 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: rgw enable usage log = true 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: debug monc = 20 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: debug ms = 1 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: debug objecter = 20 2026-02-25T14:59:50.396 INFO:teuthology.orchestra.run.trial072.stdout: debug rados = 20 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial072.stdout: rados replica read policy = balance 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial072.stdout:[mon.a] 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial072.stdout:[mon.b] 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial072.stdout:[mon.c] 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout:[global] 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout: chdir = "" 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout: auth supported = cephx 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.397 INFO:teuthology.orchestra.run.trial068.stdout: filestore xattr use omap = true 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: mon clock drift allowed = 1.000 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: osd crush chooseleaf type = 0 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: auth debug = true 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: ms die on old message = true 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: ms die on bug = true 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: mon pg warn max object skew = 0 2026-02-25T14:59:50.398 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: osd pool default size = 2 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon osd allow primary affinity = true 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon osd allow pg remap = true 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on legacy crush tunables = false 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on crush straw calc version zero = false 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on no sortbitwise = false 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on osd down out interval zero = false 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on too few osds = false 2026-02-25T14:59:50.399 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon_allow_pool_size_one = true 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: osd default data pool replay window = 5 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon allow pool delete = true 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon cluster log file level = debug 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: debug asserts on shutdown = true 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon health detail to clog = false 2026-02-25T14:59:50.400 INFO:teuthology.orchestra.run.trial068.stdout: mon host = "[v1:10.20.193.21:6789],[v1:10.20.193.31:6789],[v1:10.20.193.68:6789]" 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: mon client directed command retry = 5 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: mon election default strategy = 3 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: ms bind msgr2 = False 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: ms inject socket failures = 5000 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: ms type = async 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: osd heartbeat grace = 160 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: osd op thread timeout = 150 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: fsid = 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout:[osd] 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: osd journal size = 100 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: osd scrub load threshold = 5.0 2026-02-25T14:59:50.401 INFO:teuthology.orchestra.run.trial068.stdout: osd scrub max interval = 600 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd mclock profile = high_recovery_ops 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd mclock skip benchmark = True 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd recover clone overlap = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd recovery max chunk = 1048576 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd debug shutdown = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd debug op order = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd debug verify stray on activate = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd debug trim objects = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd open classes on start = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: osd debug pg log writeout = true 2026-02-25T14:59:50.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: osd deep scrub update digest min age = 30 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: osd map max advance = 10 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: journal zero on create = true 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: filestore ondisk finisher threads = 3 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: filestore apply finisher threads = 3 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: bdev debug aio = true 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug misdirected ops = true 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: bdev async discard = True 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: bdev enable discard = True 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: bluestore allocator = btree 2026-02-25T14:59:50.403 INFO:teuthology.orchestra.run.trial068.stdout: bluestore block size = 96636764160 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: bluestore fsck on mount = True 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: bluestore onode segment size = 0 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: bluestore write v2 random = True 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: bluestore zero block detection = True 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: crush location = root=default host=host-$id 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug bluefs = 1 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug bluestore = 1 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug monc = 20 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug osd = 20 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: debug rocksdb = 10 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: mon osd full ratio = 0.9 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: mon osd nearfull ratio = 0.8 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: osd class default list = * 2026-02-25T14:59:50.404 INFO:teuthology.orchestra.run.trial068.stdout: osd class load list = * 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd client watch timeout = 240 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd debug verify cached snaps = True 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd debug verify missing on start = True 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd failsafe full ratio = 0.95 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd fast shutdown = False 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd mclock override recovery settings = True 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd objectstore = bluestore 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd op queue = debug_random 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd op queue cut off = debug_random 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: osd shutdown pgref assert = True 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout:[mgr] 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: debug mgr = 20 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: debug mon = 20 2026-02-25T14:59:50.405 INFO:teuthology.orchestra.run.trial068.stdout: debug auth = 20 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mgr/telemetry/nag = false 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout:[mon] 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: debug mon = 20 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: debug paxos = 20 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: debug auth = 20 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon data avail warn = 5 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon mgr mkfs grace = 240 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon osd reporter subtree level = osd 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon osd prime pg temp = true 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.406 INFO:teuthology.orchestra.run.trial068.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: # 1m isn't quite enough 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon_down_mkfs_grace = 2m 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_filestore_osds = false 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon min osdmap epochs = 50 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon osd crush smoke test = False 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon osdmap full prune interval = 2 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon osdmap full prune min = 15 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon osdmap full prune txsize = 2 2026-02-25T14:59:50.407 INFO:teuthology.orchestra.run.trial068.stdout: mon scrub interval = 300 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on pool no app = False 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: paxos service trim min = 10 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout:[client] 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: rgw cache enabled = true 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: rgw enable ops log = true 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: rgw enable usage log = true 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: debug monc = 20 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: debug objecter = 20 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: debug rados = 20 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout: rados replica read policy = balance 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout:[mon.a] 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout:[mon.b] 2026-02-25T14:59:50.408 INFO:teuthology.orchestra.run.trial068.stdout:[mon.c] 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout:[global] 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: chdir = "" 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: auth supported = cephx 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: filestore xattr use omap = true 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: mon clock drift allowed = 1.000 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: osd crush chooseleaf type = 0 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: auth debug = true 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: ms die on old message = true 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: ms die on bug = true 2026-02-25T14:59:50.409 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon pg warn max object skew = 0 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: osd pool default size = 2 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon osd allow primary affinity = true 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon osd allow pg remap = true 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on legacy crush tunables = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on crush straw calc version zero = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on no sortbitwise = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on osd down out interval zero = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on too few osds = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T14:59:50.410 INFO:teuthology.orchestra.run.trial031.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon_allow_pool_size_one = true 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: osd default data pool replay window = 5 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon allow pool delete = true 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon cluster log file level = debug 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: debug asserts on shutdown = true 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon health detail to clog = false 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon host = "[v1:10.20.193.21:6789],[v1:10.20.193.31:6789],[v1:10.20.193.68:6789]" 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon client directed command retry = 5 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: mon election default strategy = 3 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: ms bind msgr2 = False 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: ms inject socket failures = 5000 2026-02-25T14:59:50.411 INFO:teuthology.orchestra.run.trial031.stdout: ms type = async 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd heartbeat grace = 160 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd op thread timeout = 150 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: fsid = 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout:[osd] 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd journal size = 100 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd scrub load threshold = 5.0 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd scrub max interval = 600 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd mclock profile = high_recovery_ops 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd mclock skip benchmark = True 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd recover clone overlap = true 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd recovery max chunk = 1048576 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd debug shutdown = true 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd debug op order = true 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd debug verify stray on activate = true 2026-02-25T14:59:50.412 INFO:teuthology.orchestra.run.trial031.stdout: osd debug trim objects = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: osd open classes on start = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: osd debug pg log writeout = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: osd deep scrub update digest min age = 30 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: osd map max advance = 10 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: journal zero on create = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: filestore ondisk finisher threads = 3 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: filestore apply finisher threads = 3 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: bdev debug aio = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: osd debug misdirected ops = true 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: bdev async discard = True 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: bdev enable discard = True 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: bluestore allocator = btree 2026-02-25T14:59:50.413 INFO:teuthology.orchestra.run.trial031.stdout: bluestore block size = 96636764160 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: bluestore fsck on mount = True 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: bluestore onode segment size = 0 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: bluestore write v2 random = True 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: bluestore zero block detection = True 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: crush location = root=default host=host-$id 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug bluefs = 1 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug bluestore = 1 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug monc = 20 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug ms = 1 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug osd = 20 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: debug rocksdb = 10 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: mon osd full ratio = 0.9 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: mon osd nearfull ratio = 0.8 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd class default list = * 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd class load list = * 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd client watch timeout = 240 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd debug verify cached snaps = True 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd debug verify missing on start = True 2026-02-25T14:59:50.414 INFO:teuthology.orchestra.run.trial031.stdout: osd failsafe full ratio = 0.95 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd fast shutdown = False 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd mclock override recovery settings = True 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd objectstore = bluestore 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd op queue = debug_random 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd op queue cut off = debug_random 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: osd shutdown pgref assert = True 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout:[mgr] 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug ms = 1 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug mgr = 20 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug mon = 20 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug auth = 20 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: mgr/telemetry/nag = false 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout:[mon] 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug ms = 1 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug mon = 20 2026-02-25T14:59:50.415 INFO:teuthology.orchestra.run.trial031.stdout: debug paxos = 20 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: debug auth = 20 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon data avail warn = 5 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon mgr mkfs grace = 240 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon reweight min pgs per osd = 4 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon osd reporter subtree level = osd 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon osd prime pg temp = true 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon reweight min bytes per osd = 10 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: # 1m isn't quite enough 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon_down_mkfs_grace = 2m 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon_warn_on_filestore_osds = false 2026-02-25T14:59:50.416 INFO:teuthology.orchestra.run.trial031.stdout: mon min osdmap epochs = 50 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon osd crush smoke test = False 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon osdmap full prune interval = 2 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon osdmap full prune min = 15 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon osdmap full prune txsize = 2 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon scrub interval = 300 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: mon warn on pool no app = False 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: paxos service trim min = 10 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout:[client] 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: rgw cache enabled = true 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: rgw enable ops log = true 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: rgw enable usage log = true 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: debug monc = 20 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: debug ms = 1 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: debug objecter = 20 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: debug rados = 20 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout: rados replica read policy = balance 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout:[mon.a] 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout:[mon.b] 2026-02-25T14:59:50.417 INFO:teuthology.orchestra.run.trial031.stdout:[mon.c] 2026-02-25T14:59:50.419 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-25T14:59:50.419 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-25T14:59:50.501 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-25T14:59:50.501 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:50.501 DEBUG:teuthology.orchestra.run.trial021:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-25T14:59:50.557 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:50.557 DEBUG:teuthology.orchestra.run.trial021:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-25T14:59:50.614 INFO:tasks.ceph:Sending monmap to node ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:59:50.614 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:50.614 DEBUG:teuthology.orchestra.run.trial021:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T14:59:50.614 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T14:59:50.687 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T14:59:50.687 DEBUG:teuthology.orchestra.run.trial021:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:50.743 INFO:tasks.ceph:Sending monmap to node ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:59:50.744 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:50.744 DEBUG:teuthology.orchestra.run.trial031:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T14:59:50.744 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T14:59:50.778 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T14:59:50.779 DEBUG:teuthology.orchestra.run.trial031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:50.834 INFO:tasks.ceph:Sending monmap to node ubuntu@trial068.front.sepia.ceph.com 2026-02-25T14:59:50.835 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:50.835 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T14:59:50.835 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T14:59:50.868 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T14:59:50.869 DEBUG:teuthology.orchestra.run.trial068:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:50.925 INFO:tasks.ceph:Sending monmap to node ubuntu@trial072.front.sepia.ceph.com 2026-02-25T14:59:50.925 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:50.925 DEBUG:teuthology.orchestra.run.trial072:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T14:59:50.925 DEBUG:teuthology.orchestra.run.trial072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T14:59:50.959 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T14:59:50.959 DEBUG:teuthology.orchestra.run.trial072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:51.019 INFO:tasks.ceph:Setting up mon nodes... 2026-02-25T14:59:51.019 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-25T14:59:51.020 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T14:59:51.065 INFO:teuthology.orchestra.run.trial021.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T14:59:51.067 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T14:59:51.110 INFO:teuthology.orchestra.run.trial072.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T14:59:51.113 INFO:tasks.ceph:Setting up mds nodes... 2026-02-25T14:59:51.113 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-25T14:59:51.113 DEBUG:teuthology.orchestra.run.trial072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-25T14:59:51.148 INFO:teuthology.orchestra.run.trial072.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-25T14:59:51.160 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-25T14:59:51.161 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial021.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial031.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial068.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial072.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-25T14:59:51.161 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-25T14:59:51.186 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:51.187 INFO:tasks.ceph:role: osd.0 2026-02-25T14:59:51.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:59:51.187 DEBUG:teuthology.orchestra.run.trial021:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:51.251 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:51.252 INFO:teuthology.orchestra.run.trial021.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:51.824 INFO:teuthology.orchestra.run.trial021.stdout:Discarding blocks...Done. 2026-02-25T14:59:51.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial021.front.sepia.ceph.com -o noatime 2026-02-25T14:59:51.826 DEBUG:teuthology.orchestra.run.trial021:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-25T14:59:51.894 DEBUG:teuthology.orchestra.run.trial021:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-25T14:59:51.960 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-25T14:59:52.023 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:52.024 INFO:tasks.ceph:role: osd.4 2026-02-25T14:59:52.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:59:52.024 DEBUG:teuthology.orchestra.run.trial021:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:52.088 INFO:teuthology.orchestra.run.trial021.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:52.649 INFO:teuthology.orchestra.run.trial021.stdout:Discarding blocks...Done. 2026-02-25T14:59:52.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial021.front.sepia.ceph.com -o noatime 2026-02-25T14:59:52.650 DEBUG:teuthology.orchestra.run.trial021:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-25T14:59:52.717 DEBUG:teuthology.orchestra.run.trial021:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-25T14:59:52.783 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-25T14:59:52.848 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:52.848 INFO:tasks.ceph:role: osd.8 2026-02-25T14:59:52.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:59:52.848 DEBUG:teuthology.orchestra.run.trial021:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:52.913 INFO:teuthology.orchestra.run.trial021.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:52.914 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:52.914 INFO:teuthology.orchestra.run.trial021.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:53.514 INFO:teuthology.orchestra.run.trial021.stdout:Discarding blocks...Done. 2026-02-25T14:59:53.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial021.front.sepia.ceph.com -o noatime 2026-02-25T14:59:53.516 DEBUG:teuthology.orchestra.run.trial021:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-25T14:59:53.584 DEBUG:teuthology.orchestra.run.trial021:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-25T14:59:53.650 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-25T14:59:53.715 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:53.715 INFO:tasks.ceph:role: osd.12 2026-02-25T14:59:53.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T14:59:53.715 DEBUG:teuthology.orchestra.run.trial021:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T14:59:53.779 INFO:teuthology.orchestra.run.trial021.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:53.780 INFO:teuthology.orchestra.run.trial021.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:53.781 INFO:teuthology.orchestra.run.trial021.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:54.337 INFO:teuthology.orchestra.run.trial021.stdout:Discarding blocks...Done. 2026-02-25T14:59:54.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial021.front.sepia.ceph.com -o noatime 2026-02-25T14:59:54.339 DEBUG:teuthology.orchestra.run.trial021:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-25T14:59:54.423 DEBUG:teuthology.orchestra.run.trial021:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-25T14:59:54.489 DEBUG:teuthology.orchestra.run.trial021:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:54.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:54.565+0000 7f22bbc70900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-25T14:59:54.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:54.566+0000 7f22bbc70900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-25T14:59:54.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:54.566+0000 7f22bbc70900 -1 bdev(0x557fc4bb9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-25T14:59:54.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:54.566+0000 7f22bbc70900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-25T14:59:55.031 DEBUG:teuthology.orchestra.run.trial021:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-25T14:59:55.096 DEBUG:teuthology.orchestra.run.trial021:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:55.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.172+0000 7f8d78d8c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-25T14:59:55.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.172+0000 7f8d78d8c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-25T14:59:55.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.172+0000 7f8d78d8c900 -1 bdev(0x55a92f245800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-25T14:59:55.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.172+0000 7f8d78d8c900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-25T14:59:55.685 DEBUG:teuthology.orchestra.run.trial021:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-25T14:59:55.750 DEBUG:teuthology.orchestra.run.trial021:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:55.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.827+0000 7f346f72b900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-25T14:59:55.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.827+0000 7f346f72b900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-25T14:59:55.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.827+0000 7f346f72b900 -1 bdev(0x561d1742f800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-25T14:59:55.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:55.828+0000 7f346f72b900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-25T14:59:56.337 DEBUG:teuthology.orchestra.run.trial021:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-25T14:59:56.403 DEBUG:teuthology.orchestra.run.trial021:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T14:59:56.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:56.480+0000 7f8c8de5b900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-25T14:59:56.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:56.480+0000 7f8c8de5b900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-25T14:59:56.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:56.480+0000 7f8c8de5b900 -1 bdev(0x55eff89db800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-25T14:59:56.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T14:59:56.481+0000 7f8c8de5b900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-25T14:59:56.958 DEBUG:teuthology.orchestra.run.trial021:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-25T14:59:57.022 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-25T14:59:57.047 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:57.047 INFO:tasks.ceph:role: osd.1 2026-02-25T14:59:57.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:59:57.047 DEBUG:teuthology.orchestra.run.trial031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T14:59:57.112 INFO:teuthology.orchestra.run.trial031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:57.112 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:57.112 INFO:teuthology.orchestra.run.trial031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:57.112 INFO:teuthology.orchestra.run.trial031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:57.113 INFO:teuthology.orchestra.run.trial031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:57.681 INFO:teuthology.orchestra.run.trial031.stdout:Discarding blocks...Done. 2026-02-25T14:59:57.683 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial031.front.sepia.ceph.com -o noatime 2026-02-25T14:59:57.684 DEBUG:teuthology.orchestra.run.trial031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-25T14:59:57.752 DEBUG:teuthology.orchestra.run.trial031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-25T14:59:57.819 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-25T14:59:57.883 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:57.883 INFO:tasks.ceph:role: osd.5 2026-02-25T14:59:57.884 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:59:57.884 DEBUG:teuthology.orchestra.run.trial031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T14:59:57.948 INFO:teuthology.orchestra.run.trial031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:57.948 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:57.948 INFO:teuthology.orchestra.run.trial031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:57.948 INFO:teuthology.orchestra.run.trial031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:57.949 INFO:teuthology.orchestra.run.trial031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:58.520 INFO:teuthology.orchestra.run.trial031.stdout:Discarding blocks...Done. 2026-02-25T14:59:58.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial031.front.sepia.ceph.com -o noatime 2026-02-25T14:59:58.523 DEBUG:teuthology.orchestra.run.trial031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-25T14:59:58.591 DEBUG:teuthology.orchestra.run.trial031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-25T14:59:58.657 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-25T14:59:58.721 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:58.722 INFO:tasks.ceph:role: osd.9 2026-02-25T14:59:58.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:59:58.722 DEBUG:teuthology.orchestra.run.trial031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T14:59:58.786 INFO:teuthology.orchestra.run.trial031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:58.787 INFO:teuthology.orchestra.run.trial031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T14:59:59.396 INFO:teuthology.orchestra.run.trial031.stdout:Discarding blocks...Done. 2026-02-25T14:59:59.398 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial031.front.sepia.ceph.com -o noatime 2026-02-25T14:59:59.399 DEBUG:teuthology.orchestra.run.trial031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-25T14:59:59.466 DEBUG:teuthology.orchestra.run.trial031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-25T14:59:59.533 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-25T14:59:59.597 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-25T14:59:59.597 INFO:tasks.ceph:role: osd.13 2026-02-25T14:59:59.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T14:59:59.597 DEBUG:teuthology.orchestra.run.trial031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T14:59:59.661 INFO:teuthology.orchestra.run.trial031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T14:59:59.661 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout: = sunit=0 swidth=0 blks 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T14:59:59.662 INFO:teuthology.orchestra.run.trial031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:00.219 INFO:teuthology.orchestra.run.trial031.stdout:Discarding blocks...Done. 2026-02-25T15:00:00.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial031.front.sepia.ceph.com -o noatime 2026-02-25T15:00:00.221 DEBUG:teuthology.orchestra.run.trial031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-25T15:00:00.306 DEBUG:teuthology.orchestra.run.trial031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-25T15:00:00.373 DEBUG:teuthology.orchestra.run.trial031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:00.453 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:00.452+0000 7fe12db51900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-25T15:00:00.454 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:00.452+0000 7fe12db51900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-25T15:00:00.454 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:00.452+0000 7fe12db51900 -1 bdev(0x556d202a3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:00.454 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:00.452+0000 7fe12db51900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-25T15:00:00.969 DEBUG:teuthology.orchestra.run.trial031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-25T15:00:01.034 DEBUG:teuthology.orchestra.run.trial031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:01.111 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.110+0000 7fe0e4970900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-25T15:00:01.112 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.110+0000 7fe0e4970900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-25T15:00:01.112 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.110+0000 7fe0e4970900 -1 bdev(0x55c67a143800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:01.113 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.110+0000 7fe0e4970900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-25T15:00:01.580 DEBUG:teuthology.orchestra.run.trial031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-25T15:00:01.646 DEBUG:teuthology.orchestra.run.trial031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:01.723 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.721+0000 7f8f5ada8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-25T15:00:01.724 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.721+0000 7f8f5ada8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-25T15:00:01.724 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.722+0000 7f8f5ada8900 -1 bdev(0x563cd524f800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:01.724 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:01.722+0000 7f8f5ada8900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-25T15:00:02.218 DEBUG:teuthology.orchestra.run.trial031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-25T15:00:02.284 DEBUG:teuthology.orchestra.run.trial031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:02.362 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:02.359+0000 7f97c7ab8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-25T15:00:02.362 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:02.360+0000 7f97c7ab8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-25T15:00:02.362 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:02.360+0000 7f97c7ab8900 -1 bdev(0x556f26077800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:02.362 INFO:teuthology.orchestra.run.trial031.stderr:2026-02-25T15:00:02.360+0000 7f97c7ab8900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-25T15:00:02.853 DEBUG:teuthology.orchestra.run.trial031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-25T15:00:02.918 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-25T15:00:02.945 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:02.945 INFO:tasks.ceph:role: osd.2 2026-02-25T15:00:02.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:00:02.946 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:00:03.011 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:03.011 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:03.011 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:03.011 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:03.012 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:03.589 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-25T15:00:03.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-25T15:00:03.592 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-25T15:00:03.660 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-25T15:00:03.728 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-25T15:00:03.792 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:03.793 INFO:tasks.ceph:role: osd.6 2026-02-25T15:00:03.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:00:03.793 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:00:03.858 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:03.858 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:03.858 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:03.858 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:03.859 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:04.415 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-25T15:00:04.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-25T15:00:04.417 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-25T15:00:04.486 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-25T15:00:04.553 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-25T15:00:04.617 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:04.617 INFO:tasks.ceph:role: osd.10 2026-02-25T15:00:04.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:00:04.617 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:04.682 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:04.683 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:04.683 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:05.254 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-25T15:00:05.256 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-25T15:00:05.256 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-25T15:00:05.325 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-25T15:00:05.392 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-25T15:00:05.455 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:05.456 INFO:tasks.ceph:role: osd.14 2026-02-25T15:00:05.456 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:00:05.456 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:00:05.521 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:05.521 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:05.521 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:05.521 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:05.521 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:05.522 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:05.522 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:05.522 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:05.522 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:05.522 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:06.077 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-25T15:00:06.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-25T15:00:06.079 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-25T15:00:06.162 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-25T15:00:06.229 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:06.308 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.306+0000 7f8967e7a900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-25T15:00:06.309 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.307+0000 7f8967e7a900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-25T15:00:06.309 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.307+0000 7f8967e7a900 -1 bdev(0x55c06713d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:06.309 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.307+0000 7f8967e7a900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-25T15:00:06.843 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-25T15:00:06.909 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:06.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.986+0000 7f0d2fc67900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-25T15:00:06.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.986+0000 7f0d2fc67900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-25T15:00:06.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.986+0000 7f0d2fc67900 -1 bdev(0x55aad85b7800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:06.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:06.986+0000 7f0d2fc67900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-25T15:00:07.459 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-25T15:00:07.526 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:07.604 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:07.602+0000 7f6392df2900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-25T15:00:07.605 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:07.602+0000 7f6392df2900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-25T15:00:07.605 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:07.603+0000 7f6392df2900 -1 bdev(0x55bca9ce3800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:07.605 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:07.603+0000 7f6392df2900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-25T15:00:08.113 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-25T15:00:08.180 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:08.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:08.255+0000 7fe71f2c8900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-25T15:00:08.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:08.256+0000 7fe71f2c8900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-25T15:00:08.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:08.256+0000 7fe71f2c8900 -1 bdev(0x563b2f939800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:08.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-25T15:00:08.256+0000 7fe71f2c8900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-25T15:00:08.735 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-25T15:00:08.801 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-25T15:00:08.827 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:08.827 INFO:tasks.ceph:role: osd.3 2026-02-25T15:00:08.827 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:00:08.827 DEBUG:teuthology.orchestra.run.trial072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T15:00:08.892 INFO:teuthology.orchestra.run.trial072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:08.892 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:08.893 INFO:teuthology.orchestra.run.trial072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:09.473 INFO:teuthology.orchestra.run.trial072.stdout:Discarding blocks...Done. 2026-02-25T15:00:09.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial072.front.sepia.ceph.com -o noatime 2026-02-25T15:00:09.476 DEBUG:teuthology.orchestra.run.trial072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-25T15:00:09.545 DEBUG:teuthology.orchestra.run.trial072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-25T15:00:09.612 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-25T15:00:09.676 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:09.676 INFO:tasks.ceph:role: osd.7 2026-02-25T15:00:09.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:00:09.676 DEBUG:teuthology.orchestra.run.trial072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T15:00:09.740 INFO:teuthology.orchestra.run.trial072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:09.741 INFO:teuthology.orchestra.run.trial072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:10.297 INFO:teuthology.orchestra.run.trial072.stdout:Discarding blocks...Done. 2026-02-25T15:00:10.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial072.front.sepia.ceph.com -o noatime 2026-02-25T15:00:10.300 DEBUG:teuthology.orchestra.run.trial072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-25T15:00:10.368 DEBUG:teuthology.orchestra.run.trial072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-25T15:00:10.435 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-25T15:00:10.499 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:10.499 INFO:tasks.ceph:role: osd.11 2026-02-25T15:00:10.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:00:10.499 DEBUG:teuthology.orchestra.run.trial072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T15:00:10.564 INFO:teuthology.orchestra.run.trial072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:10.564 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:10.564 INFO:teuthology.orchestra.run.trial072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:10.564 INFO:teuthology.orchestra.run.trial072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:10.564 INFO:teuthology.orchestra.run.trial072.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:10.565 INFO:teuthology.orchestra.run.trial072.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:10.565 INFO:teuthology.orchestra.run.trial072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:10.565 INFO:teuthology.orchestra.run.trial072.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:10.565 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:10.565 INFO:teuthology.orchestra.run.trial072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:11.135 INFO:teuthology.orchestra.run.trial072.stdout:Discarding blocks...Done. 2026-02-25T15:00:11.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial072.front.sepia.ceph.com -o noatime 2026-02-25T15:00:11.137 DEBUG:teuthology.orchestra.run.trial072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-25T15:00:11.205 DEBUG:teuthology.orchestra.run.trial072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-25T15:00:11.271 DEBUG:teuthology.orchestra.run.trial072:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-25T15:00:11.335 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-25T15:00:11.335 INFO:tasks.ceph:role: osd.15 2026-02-25T15:00:11.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:00:11.336 DEBUG:teuthology.orchestra.run.trial072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T15:00:11.400 INFO:teuthology.orchestra.run.trial072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T15:00:11.400 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T15:00:11.400 INFO:teuthology.orchestra.run.trial072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T15:00:11.400 INFO:teuthology.orchestra.run.trial072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout: = sunit=0 swidth=0 blks 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T15:00:11.401 INFO:teuthology.orchestra.run.trial072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T15:00:11.955 INFO:teuthology.orchestra.run.trial072.stdout:Discarding blocks...Done. 2026-02-25T15:00:11.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial072.front.sepia.ceph.com -o noatime 2026-02-25T15:00:11.958 DEBUG:teuthology.orchestra.run.trial072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-25T15:00:12.034 DEBUG:teuthology.orchestra.run.trial072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-25T15:00:12.101 DEBUG:teuthology.orchestra.run.trial072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:12.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.179+0000 7f8485579900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-25T15:00:12.181 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.179+0000 7f8485579900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-25T15:00:12.181 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.179+0000 7f8485579900 -1 bdev(0x5603d619f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:12.181 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.179+0000 7f8485579900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-25T15:00:12.654 DEBUG:teuthology.orchestra.run.trial072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-25T15:00:12.719 DEBUG:teuthology.orchestra.run.trial072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:12.798 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.797+0000 7f79f2214900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-25T15:00:12.799 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.797+0000 7f79f2214900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-25T15:00:12.799 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.797+0000 7f79f2214900 -1 bdev(0x55b507129800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:12.799 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:12.797+0000 7f79f2214900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-25T15:00:13.263 DEBUG:teuthology.orchestra.run.trial072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-25T15:00:13.328 DEBUG:teuthology.orchestra.run.trial072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:13.406 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:13.404+0000 7f59fdf93900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-25T15:00:13.406 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:13.405+0000 7f59fdf93900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-25T15:00:13.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:13.405+0000 7f59fdf93900 -1 bdev(0x55655097f800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:13.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:13.405+0000 7f59fdf93900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-25T15:00:13.896 DEBUG:teuthology.orchestra.run.trial072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-25T15:00:13.962 DEBUG:teuthology.orchestra.run.trial072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:14.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:14.040+0000 7fa89e40f900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-25T15:00:14.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:14.040+0000 7fa89e40f900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-25T15:00:14.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:14.040+0000 7fa89e40f900 -1 bdev(0x55dd2c75b800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-25T15:00:14.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:14.040+0000 7fa89e40f900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-25T15:00:14.544 DEBUG:teuthology.orchestra.run.trial072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-25T15:00:14.608 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-25T15:00:14.609 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:14.609 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-25T15:00:14.636 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:14.637 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-25T15:00:14.702 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:14.703 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-25T15:00:14.767 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:14.767 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-25T15:00:14.830 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:14.830 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-25T15:00:14.894 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:14.895 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-25T15:00:14.921 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:14.921 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-25T15:00:14.986 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:14.986 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-25T15:00:15.050 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:15.050 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-25T15:00:15.116 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:15.116 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-25T15:00:15.142 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:15.142 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-25T15:00:15.206 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:15.207 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-25T15:00:15.270 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:15.270 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-25T15:00:15.332 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.333 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-25T15:00:15.358 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.358 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-25T15:00:15.421 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.422 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-25T15:00:15.484 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.484 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-25T15:00:15.548 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.548 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-25T15:00:15.611 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:15.611 DEBUG:teuthology.orchestra.run.trial072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-25T15:00:15.667 INFO:tasks.ceph:Adding keys to all mons... 2026-02-25T15:00:15.667 DEBUG:teuthology.orchestra.run.trial021:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:00:15.668 DEBUG:teuthology.orchestra.run.trial031:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:00:15.670 DEBUG:teuthology.orchestra.run.trial068:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[mgr.y] 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBnDp9pgTjlAxAA2rS9STgSGb10+vsq8Wf+jg== 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[osd.0] 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBqDp9phHXWIRAAlDsK/JowF0PaEjAp73xmGg== 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[osd.4] 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBrDp9pqN9TChAA8SanrQ0AG0vBRDPnS62z0A== 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[osd.8] 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBrDp9pl+FcMRAABXQyFBZfkcsGX7e+dPmP9Q== 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[osd.12] 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBsDp9pl6exHBAAzy4OkLxqYOXUkzAhTbyP4Q== 2026-02-25T15:00:15.689 INFO:teuthology.orchestra.run.trial021.stdout:[osd.1] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBwDp9pgjAAGxAAsWERfayfzGtpMxXa+XUVGg== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.5] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBxDp9pXnGeBhAA2W/wBOTQbxaA3Oaid4rK+g== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.9] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBxDp9pkcMPKxAAeUtIC2opGArC3mdgJVIy/Q== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.13] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQByDp9pcUmAFRAAgyulwbZhL/94MPz7T+J37w== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.2] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB2Dp9pmhhfEhAAXkxUFRxOzc3ZaNRPol2lHQ== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.6] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB2Dp9plprdOhAAeOyD7Cb8QG14schRawltgw== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.10] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB3Dp9p83L/IxAA3iWQ2zHHyo0sqrR81lgvog== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.14] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB4Dp9pB/JUDxAA7e/Am/+ypmFGPwF98qj4VQ== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[mgr.x] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBnDp9p2q+TBhAAboaBYVmCh9hMn1blg97Hxw== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.3] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB8Dp9poqC3ChAAt9gQfYTQULO9kwJQm63uhA== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.7] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB8Dp9pUpCLLxAA8f/YkVhfHziI8TXlMJ6Fbg== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.11] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB9Dp9pBNAqGBAAf7Tioo6c9MAJd0/BI1oNSQ== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[osd.15] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQB+Dp9pwFdtAhAA/dXW2v9hHccvhTzAhPKxIA== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout:[client.0] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial021.stdout: key = AQBnDp9prx3UCBAAM3NJc7hBMOmGpPsjlJ0ERQ== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout:[mgr.y] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBnDp9pgTjlAxAA2rS9STgSGb10+vsq8Wf+jg== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout:[osd.0] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBqDp9phHXWIRAAlDsK/JowF0PaEjAp73xmGg== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout:[osd.4] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBrDp9pqN9TChAA8SanrQ0AG0vBRDPnS62z0A== 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout:[osd.8] 2026-02-25T15:00:15.690 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBrDp9pl+FcMRAABXQyFBZfkcsGX7e+dPmP9Q== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.12] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBsDp9pl6exHBAAzy4OkLxqYOXUkzAhTbyP4Q== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.1] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBwDp9pgjAAGxAAsWERfayfzGtpMxXa+XUVGg== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.5] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBxDp9pXnGeBhAA2W/wBOTQbxaA3Oaid4rK+g== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.9] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBxDp9pkcMPKxAAeUtIC2opGArC3mdgJVIy/Q== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.13] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQByDp9pcUmAFRAAgyulwbZhL/94MPz7T+J37w== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.2] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB2Dp9pmhhfEhAAXkxUFRxOzc3ZaNRPol2lHQ== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.6] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB2Dp9plprdOhAAeOyD7Cb8QG14schRawltgw== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.10] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB3Dp9p83L/IxAA3iWQ2zHHyo0sqrR81lgvog== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.14] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB4Dp9pB/JUDxAA7e/Am/+ypmFGPwF98qj4VQ== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[mgr.x] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBnDp9p2q+TBhAAboaBYVmCh9hMn1blg97Hxw== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.3] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB8Dp9poqC3ChAAt9gQfYTQULO9kwJQm63uhA== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.7] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB8Dp9pUpCLLxAA8f/YkVhfHziI8TXlMJ6Fbg== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.11] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB9Dp9pBNAqGBAAf7Tioo6c9MAJd0/BI1oNSQ== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[osd.15] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQB+Dp9pwFdtAhAA/dXW2v9hHccvhTzAhPKxIA== 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout:[client.0] 2026-02-25T15:00:15.691 INFO:teuthology.orchestra.run.trial031.stdout: key = AQBnDp9prx3UCBAAM3NJc7hBMOmGpPsjlJ0ERQ== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[mgr.y] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBnDp9pgTjlAxAA2rS9STgSGb10+vsq8Wf+jg== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.0] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBqDp9phHXWIRAAlDsK/JowF0PaEjAp73xmGg== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.4] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBrDp9pqN9TChAA8SanrQ0AG0vBRDPnS62z0A== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.8] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBrDp9pl+FcMRAABXQyFBZfkcsGX7e+dPmP9Q== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.12] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBsDp9pl6exHBAAzy4OkLxqYOXUkzAhTbyP4Q== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.1] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBwDp9pgjAAGxAAsWERfayfzGtpMxXa+XUVGg== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.5] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBxDp9pXnGeBhAA2W/wBOTQbxaA3Oaid4rK+g== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.9] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBxDp9pkcMPKxAAeUtIC2opGArC3mdgJVIy/Q== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.13] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQByDp9pcUmAFRAAgyulwbZhL/94MPz7T+J37w== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.2] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB2Dp9pmhhfEhAAXkxUFRxOzc3ZaNRPol2lHQ== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.6] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB2Dp9plprdOhAAeOyD7Cb8QG14schRawltgw== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.10] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB3Dp9p83L/IxAA3iWQ2zHHyo0sqrR81lgvog== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.14] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB4Dp9pB/JUDxAA7e/Am/+ypmFGPwF98qj4VQ== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[mgr.x] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBnDp9p2q+TBhAAboaBYVmCh9hMn1blg97Hxw== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.3] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB8Dp9poqC3ChAAt9gQfYTQULO9kwJQm63uhA== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.7] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB8Dp9pUpCLLxAA8f/YkVhfHziI8TXlMJ6Fbg== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.11] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB9Dp9pBNAqGBAAf7Tioo6c9MAJd0/BI1oNSQ== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[osd.15] 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout: key = AQB+Dp9pwFdtAhAA/dXW2v9hHccvhTzAhPKxIA== 2026-02-25T15:00:15.693 INFO:teuthology.orchestra.run.trial068.stdout:[client.0] 2026-02-25T15:00:15.694 INFO:teuthology.orchestra.run.trial068.stdout: key = AQBnDp9prx3UCBAAM3NJc7hBMOmGpPsjlJ0ERQ== 2026-02-25T15:00:15.694 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:15.733 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:15.734 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:15.812 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.854 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.856 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.895 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.937 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.940 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:15.980 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.016 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.021 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.060 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.095 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.101 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.142 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.175 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.182 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.222 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.254 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.261 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.301 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.334 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.342 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.382 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.414 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.422 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.461 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.492 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.501 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.541 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.571 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.581 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.622 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.651 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.661 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.701 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.731 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.741 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.782 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:16.810 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:16.821 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T15:00:16.860 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.889 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.900 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.939 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.969 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:16.979 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.019 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.050 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.059 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.100 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.131 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.139 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T15:00:17.179 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:00:17.210 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:00:17.220 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-25T15:00:17.260 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-25T15:00:17.261 DEBUG:teuthology.orchestra.run.trial021:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-25T15:00:17.312 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:00:17.399 DEBUG:teuthology.orchestra.run.trial021:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-25T15:00:17.424 DEBUG:teuthology.orchestra.run.trial031:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-25T15:00:17.449 DEBUG:teuthology.orchestra.run.trial031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:00:17.535 DEBUG:teuthology.orchestra.run.trial031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-25T15:00:17.559 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-25T15:00:17.584 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T15:00:17.671 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-25T15:00:17.696 DEBUG:teuthology.orchestra.run.trial021:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:17.698 DEBUG:teuthology.orchestra.run.trial031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:17.701 DEBUG:teuthology.orchestra.run.trial068:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T15:00:17.752 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-25T15:00:17.752 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:00:17.752 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T15:00:17.753 DEBUG:teuthology.orchestra.run.trial021:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-25T15:00:17.755 INFO:tasks.ceph.mon.a:Started 2026-02-25T15:00:17.756 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:00:17.756 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-25T15:00:17.756 DEBUG:teuthology.orchestra.run.trial031:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-25T15:00:17.759 INFO:tasks.ceph.mon.b:Started 2026-02-25T15:00:17.759 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-25T15:00:17.759 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-25T15:00:17.759 DEBUG:teuthology.orchestra.run.trial068:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-25T15:00:17.794 INFO:tasks.ceph.mon.c:Started 2026-02-25T15:00:17.794 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-25T15:00:17.794 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-25T15:00:17.794 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-25T15:00:17.796 INFO:tasks.ceph.mgr.y:Started 2026-02-25T15:00:17.797 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T15:00:17.797 DEBUG:teuthology.orchestra.run.trial072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-25T15:00:17.799 INFO:tasks.ceph.mgr.x:Started 2026-02-25T15:00:17.800 DEBUG:tasks.ceph:set 0 configs 2026-02-25T15:00:17.800 DEBUG:teuthology.orchestra.run.trial021:> sudo ceph --cluster ceph config dump 2026-02-25T15:00:17.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 10 monclient: get_monmap_and_config 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 10 monclient: build_initial_monmap 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 10 monclient: monmap: 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:00:17.864934+0000 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:00:17.864934+0000 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:17.866 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:17.867 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:17.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 1 Processor -- start 2026-02-25T15:00:17.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 1 -- start start 2026-02-25T15:00:17.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.864+0000 7f0da5dd9640 10 monclient: init 2026-02-25T15:00:17.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-a con 0x7f0da01626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da01655c0 con 0x7f0da01626a0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b12b0 con 0x7f0da00b0410 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1590 con 0x7f0da0058da0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0da5dd9640 10 monclient(hunting): authenticate will time out at 2961.457312s 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0da01c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:17.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.865+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:17.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:17.869+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da0164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:18.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.066+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0da01c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:18.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.067+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:18.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.070+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da0164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:18.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.467+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0da01c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:18.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.468+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:18.473 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:18.472+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da0164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:19.268+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0da01c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:19.269+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:19.273+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da0164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:19.864 INFO:tasks.ceph.mon.b.trial031.stderr:--00:00:00:02.055 44814-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/90/380c19a32fd4beea3cb0388d22417b25838f9e.debug 2026-02-25T15:00:19.874 INFO:tasks.ceph.mon.a.trial021.stderr:--00:00:00:02.068 45070-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/90/380c19a32fd4beea3cb0388d22417b25838f9e.debug 2026-02-25T15:00:19.928 INFO:tasks.ceph.mon.c.trial068.stderr:--00:00:00:02.085 44953-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/90/380c19a32fd4beea3cb0388d22417b25838f9e.debug 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): tick 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 monclient(hunting): continuing hunt 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01647a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da0164eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0da01c6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:20.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0da01626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1870 con 0x7f0da01626a0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da01655c0 con 0x7f0da00b0410 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c066850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b12b0 con 0x7f0da0058da0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9d7fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:20.865+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:21.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.066+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c066850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:21.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.066+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:21.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.066+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:21.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.467+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c066850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:21.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.467+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:21.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:21.467+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:22.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:22.268+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c0237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:22.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:22.268+0000 7f0d9effd640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:22.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:22.269+0000 7f0d9ffff640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c066850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:23.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): tick 2026-02-25T15:00:23.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:00:23.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 monclient(hunting): continuing hunt 2026-02-25T15:00:23.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:00:23.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c0237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c066850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0da01626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1590 con 0x7f0da01626a0 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1870 con 0x7f0da00b0410 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da01655c0 con 0x7f0da0058da0 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9d7fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:23.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9effd640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:23.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:23.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:23.865+0000 7f0d9ffff640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:24.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.066+0000 7f0d9effd640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:24.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.066+0000 7f0d9ffff640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:24.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.067+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:24.096 INFO:tasks.ceph.mon.b.trial031.stderr:--00:00:00:06.288 44814-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/74/cc669080706d0b703f0059c774676798cfdb1f.debug 2026-02-25T15:00:24.134 INFO:tasks.ceph.mon.a.trial021.stderr:--00:00:00:06.328 45070-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/74/cc669080706d0b703f0059c774676798cfdb1f.debug 2026-02-25T15:00:24.177 INFO:tasks.ceph.mon.c.trial068.stderr:--00:00:00:06.334 44953-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/74/cc669080706d0b703f0059c774676798cfdb1f.debug 2026-02-25T15:00:24.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.467+0000 7f0d9ffff640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:24.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.467+0000 7f0d9effd640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:24.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:24.468+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:25.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:25.268+0000 7f0d9effd640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.21:6789/0 2026-02-25T15:00:25.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:25.268+0000 7f0d9ffff640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.68:6789/0 2026-02-25T15:00:25.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:25.269+0000 7f0d9f7fe640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.31:6789/0 2026-02-25T15:00:25.600 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:00:07.792 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:25.642 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:00:07.836 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:25.684 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:00:07.842 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:25.749 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:00:07.941 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:25.791 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:00:07.985 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:25.833 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:00:07.991 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:00:26.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): tick 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 monclient(hunting): continuing hunt 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:26.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0da01626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:26.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b12b0 con 0x7f0da01626a0 2026-02-25T15:00:26.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1590 con 0x7f0da00b0410 2026-02-25T15:00:26.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b1870 con 0x7f0da0058da0 2026-02-25T15:00:26.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.865+0000 7f0d9d7fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:26.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.871+0000 7f0d9effd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 0x7f0d7c044f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:39038/0 (socket says 10.20.193.21:39038) 2026-02-25T15:00:26.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:26.871+0000 7f0d9effd640 1 -- 10.20.193.21:0/1787311656 learned_addr learned my addr 10.20.193.21:0/1787311656 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): tick 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 monclient(hunting): continuing hunt 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c044f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:29.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.21:6789/0 conn(0x7f0da01626a0 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0d7c066990 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da01655c0 con 0x7f0d7c066990 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c023ef0 con 0x7f0da00b0410 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c0250d0 con 0x7f0da0058da0 2026-02-25T15:00:29.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:29.865+0000 7f0d9d7fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:32.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): tick 2026-02-25T15:00:32.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): _check_auth_tickets 2026-02-25T15:00:32.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 monclient(hunting): continuing hunt 2026-02-25T15:00:32.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-25T15:00:32.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.21:6789/0 conn(0x7f0d7c066990 legacy=0x7f0d7c06a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f0d7c0456a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c0262b0 con 0x7f0d7c0456a0 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c0462f0 con 0x7f0da00b0410 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c06a7e0 con 0x7f0da0058da0 2026-02-25T15:00:32.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:32.864+0000 7f0d9d7fa640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294845189 0 0) 0x7f0d7c0262b0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 10 monclient(hunting): my global_id is 4104 2026-02-25T15:00:33.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.362+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d84003610 con 0x7f0d7c0456a0 2026-02-25T15:00:33.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672582325 0 0) 0x7f0d7c06a7e0 con 0x7f0da0058da0 2026-02-25T15:00:33.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 10 monclient(hunting): my global_id is 4100 2026-02-25T15:00:33.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.370+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d7c0262b0 con 0x7f0da0058da0 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510022309 0 0) 0x7f0d7c0462f0 con 0x7f0da00b0410 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 10 monclient(hunting): my global_id is 4105 2026-02-25T15:00:33.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.381+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d7c06a7e0 con 0x7f0da00b0410 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1923454212 0 0) 0x7f0d7c0262b0 con 0x7f0da0058da0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0d7c06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.21:6789/0 conn(0x7f0d7c0456a0 legacy=0x7f0d7c045a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 monclient: found mon.noname-c 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c06a9b0 con 0x7f0da0058da0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d94004500 con 0x7f0da0058da0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0d9e7fc640 10 monclient: dump: 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0da5dd9640 5 monclient: authenticate success, global_id 4100 2026-02-25T15:00:33.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.392+0000 7f0da5dd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:33.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d94004710 con 0x7f0da0058da0 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 1 -- 10.20.193.21:0/1787311656 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d94004ae0 con 0x7f0da0058da0 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0d9e7fc640 10 monclient: dump: 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.421 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 4 set_mon_vals no callback set 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 10 monclient: shutdown 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 1 -- 10.20.193.21:0/1787311656 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0d7c023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 1 -- 10.20.193.21:0/1787311656 shutdown_connections 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 1 -- 10.20.193.21:0/1787311656 >> 10.20.193.21:0/1787311656 conn(0x7f0da00b65f0 msgr2=0x7f0da00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:33.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 1 -- 10.20.193.21:0/1787311656 shutdown_connections 2026-02-25T15:00:33.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.417+0000 7f0da5dd9640 1 -- 10.20.193.21:0/1787311656 wait complete. 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 10 monclient: build_initial_monmap 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 10 monclient: monmap: 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:33.425 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 1 librados: starting msgr at 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 1 librados: starting objecter 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.418+0000 7f0da5dd9640 1 Processor -- start 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 -- start start 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 librados: setting wanted keys 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 librados: calling monclient init 2026-02-25T15:00:33.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient: init 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-a con 0x7f0d7c0456a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-c con 0x7f0da0058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient(hunting): picked mon.noname-b con 0x7f0da00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da013ea20 con 0x7f0d7c0456a0 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da013ed00 con 0x7f0da00b0410 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da013efe0 con 0x7f0da0058da0 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0da5dd9640 10 monclient(hunting): authenticate will time out at 2977.012590s 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0d9f7fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f0d7c0456a0 0x7f0da01fa080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:52910/0 (socket says 10.20.193.21:52910) 2026-02-25T15:00:33.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0d9f7fe640 1 -- 10.20.193.21:0/346145286 learned_addr learned my addr 10.20.193.21:0/346145286 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0d7bfff640 10 client.?.objecter ms_handle_connect 0x7f0d7c0456a0 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.419+0000 7f0d7bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.420+0000 7f0d7bfff640 10 client.?.objecter ms_handle_connect 0x7f0da00b0410 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.420+0000 7f0d7bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.424+0000 7f0d7bfff640 10 client.?.objecter ms_handle_connect 0x7f0da0058da0 2026-02-25T15:00:33.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.424+0000 7f0d7bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.431+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110828543 0 0) 0x7f0da013ed00 con 0x7f0da00b0410 2026-02-25T15:00:33.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.432+0000 7f0d7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.432+0000 7f0d7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.432+0000 7f0d7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.432+0000 7f0d7bfff640 10 monclient(hunting): my global_id is 4114 2026-02-25T15:00:33.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.432+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d70003610 con 0x7f0da00b0410 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664427085 0 0) 0x7f0da013efe0 con 0x7f0da0058da0 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 10 monclient(hunting): my global_id is 4115 2026-02-25T15:00:33.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.433+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0da013ed00 con 0x7f0da0058da0 2026-02-25T15:00:33.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479468654 0 0) 0x7f0da013ea20 con 0x7f0d7c0456a0 2026-02-25T15:00:33.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 10 monclient(hunting): my global_id is 4113 2026-02-25T15:00:33.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.435+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0da013efe0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.447+0000 7f0d9effd640 1 -- 10.20.193.21:0/346145286 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-25T15:00:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.447+0000 7f0d9effd640 1 -- 10.20.193.21:0/346145286 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-25T15:00:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.447+0000 7f0d9effd640 1 --1- 10.20.193.21:0/346145286 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 0x7f0da01fc180 :-1 s=OPENED pgs=17 cs=1 l=1).handle_message read tag failed 2026-02-25T15:00:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.447+0000 7f0d9effd640 1 --1- 10.20.193.21:0/346145286 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 0x7f0da01fc180 :-1 s=OPENED pgs=17 cs=1 l=1).fault on lossy channel, failing 2026-02-25T15:00:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.447+0000 7f0d7bfff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.68:6789/0 2026-02-25T15:00:33.506 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4205878130 0 0) 0x7f0da013efe0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.506 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0da013ea20 con 0x7f0d7c0456a0 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d8c004240 con 0x7f0d7c0456a0 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 10 monclient(hunting): dump: 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.507 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.508 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.508 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.508 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.508 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.504+0000 7f0d7bfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4243423595 0 0) 0x7f0d70003610 con 0x7f0da00b0410 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0da013efe0 con 0x7f0da00b0410 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d94004a60 con 0x7f0da00b0410 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.513+0000 7f0d7bfff640 10 monclient(hunting): dump: 2026-02-25T15:00:33.516 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.517 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 883753185 0 0) 0x7f0da013ea20 con 0x7f0d7c0456a0 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 >> v1:10.20.193.68:6789/0 conn(0x7f0da0058da0 legacy=0x7f0da01fc180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 >> v1:10.20.193.31:6789/0 conn(0x7f0da00b0410 legacy=0x7f0da013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 1 monclient: found mon.a 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da013f2c0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 10 monclient: _finish_auth 0 2026-02-25T15:00:33.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0d7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 5 monclient: authenticate success, global_id 4113 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 10 monclient: _renew_subs 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0da013f5a0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 10 client.4113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 10 monclient: _renew_subs 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0da0137c80 con 0x7f0d7c0456a0 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.551+0000 7f0da5dd9640 1 librados: init done 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.552+0000 7f0da5dd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.552+0000 7f0da5dd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.552+0000 7f0da5dd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:33.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.552+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da00afea0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.634+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d8c0046c0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.634+0000 7f0d7bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:33.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.634+0000 7f0d9dffb640 4 set_mon_vals no callback set 2026-02-25T15:00:33.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d8c004ad0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 monclient: dump: 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.645 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f0d8c005100 con 0x7f0d7c0456a0 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 2181459385 0 0) 0x7f0d8c006ac0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 client.4113.objecter ms_dispatch2 0x7f0da0000b90 osd_map(1..1 src has 1..1) 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 3 client.4113.objecter handle_osd_map got epochs [1,1] > 0 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 3 client.4113.objecter handle_osd_map decoding full epoch 1 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 20 client.4113.objecter dump_active .. 0 homeless 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f0d8c019f00 con 0x7f0d7c0456a0 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.641+0000 7f0d7bfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:33.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.670+0000 7f0da5dd9640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-25T15:00:33.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.670+0000 7f0da5dd9640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-25T15:00:33.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.670+0000 7f0da5dd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:33.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.670+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f0da00afbc0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.697+0000 7f0d7bfff640 1 -- 10.20.193.21:0/346145286 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f0d8c005ca0 con 0x7f0d7c0456a0 2026-02-25T15:00:33.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.697+0000 7f0d7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-25T15:00:33.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.697+0000 7f0d7bfff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:33.700 INFO:teuthology.orchestra.run.trial021.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 10 librados: watch_flush enter 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 10 librados: watch_flush exit 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 20 client.4113.objecter shutdown clearing up homeless session... 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 10 client.4113.objecter successfully canceled tick 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 10 monclient: shutdown 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:33.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 >> v1:10.20.193.21:6789/0 conn(0x7f0d7c0456a0 legacy=0x7f0da01fa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 shutdown_connections 2026-02-25T15:00:33.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 >> 10.20.193.21:0/346145286 conn(0x7f0da00b65f0 msgr2=0x7f0da0055a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:33.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 shutdown_connections 2026-02-25T15:00:33.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 -- 10.20.193.21:0/346145286 wait complete. 2026-02-25T15:00:33.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.698+0000 7f0da5dd9640 1 librados: shutdown 2026-02-25T15:00:33.709 INFO:tasks.ceph:Setting crush tunables to default 2026-02-25T15:00:33.709 DEBUG:teuthology.orchestra.run.trial021:> sudo ceph --cluster ceph osd crush tunables default 2026-02-25T15:00:33.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.772+0000 7f3926d13640 10 monclient: get_monmap_and_config 2026-02-25T15:00:33.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.772+0000 7f3926d13640 10 monclient: build_initial_monmap 2026-02-25T15:00:33.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.772+0000 7f3926d13640 10 monclient: monmap: 2026-02-25T15:00:33.775 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:33.775 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:00:33.774582+0000 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:00:33.774582+0000 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:33.776 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 1 Processor -- start 2026-02-25T15:00:33.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 1 -- start start 2026-02-25T15:00:33.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient: init 2026-02-25T15:00:33.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:33.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-b con 0x7f392015afd0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-a con 0x7f392015b3a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-c con 0x7f3920163890 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3920162380 con 0x7f392015b3a0 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200b1c30 con 0x7f392015afd0 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200b1f10 con 0x7f3920163890 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.773+0000 7f3926d13640 10 monclient(hunting): authenticate will time out at 2977.366837s 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.774+0000 7f3925289640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3920163890 0x7f3920164480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:59980/0 (socket says 10.20.193.21:59980) 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.774+0000 7f3925289640 1 -- 10.20.193.21:0/609096033 learned_addr learned my addr 10.20.193.21:0/609096033 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 841966125 0 0) 0x7f39200b1f10 con 0x7f3920163890 2026-02-25T15:00:33.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 10 monclient(hunting): my global_id is 4118 2026-02-25T15:00:33.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.775+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f390c003610 con 0x7f3920163890 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.777+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3553287812 0 0) 0x7f390c003610 con 0x7f3920163890 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.777+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 >> v1:10.20.193.31:6789/0 conn(0x7f392015afd0 legacy=0x7f3920059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.777+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 >> v1:10.20.193.21:6789/0 conn(0x7f392015b3a0 legacy=0x7f392005d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 1 monclient: found mon.noname-c 2026-02-25T15:00:33.781 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b21f0 con 0x7f3920163890 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f3926d13640 5 monclient: authenticate success, global_id 4118 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f3926d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f391c003170 con 0x7f3920163890 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f39177fe640 10 monclient: dump: 2026-02-25T15:00:33.782 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.778+0000 7f3926d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f391c0033c0 con 0x7f3920163890 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 1 -- 10.20.193.21:0/609096033 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f391c003800 con 0x7f3920163890 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f39177fe640 10 monclient: dump: 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.787 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 4 set_mon_vals no callback set 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 10 monclient: shutdown 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:33.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 1 -- 10.20.193.21:0/609096033 >> v1:10.20.193.68:6789/0 conn(0x7f3920163890 legacy=0x7f3920164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 1 -- 10.20.193.21:0/609096033 shutdown_connections 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 1 -- 10.20.193.21:0/609096033 >> 10.20.193.21:0/609096033 conn(0x7f39200b2f10 msgr2=0x7f39200b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 1 -- 10.20.193.21:0/609096033 shutdown_connections 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.779+0000 7f3926d13640 1 -- 10.20.193.21:0/609096033 wait complete. 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient: build_initial_monmap 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient: monmap: 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:00:33.789 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 librados: starting msgr at 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 librados: starting objecter 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 Processor -- start 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 -- start start 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 librados: setting wanted keys 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 librados: calling monclient init 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient: init 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:33.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-a con 0x7f392015afd0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-b con 0x7f392015b3a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient(hunting): picked mon.noname-c con 0x7f3920163890 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39200576c0 con 0x7f392015afd0 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39201fb7d0 con 0x7f392015b3a0 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39201fbab0 con 0x7f3920163890 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.780+0000 7f3926d13640 10 monclient(hunting): authenticate will time out at 2977.373838s 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f3924a88640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f392015afd0 0x7f3920056fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:52932/0 (socket says 10.20.193.21:52932) 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f3924a88640 1 -- 10.20.193.21:0/1469323525 learned_addr learned my addr 10.20.193.21:0/1469323525 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:33.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f39157fa640 10 client.?.objecter ms_handle_connect 0x7f392015afd0 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f39157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f39157fa640 10 client.?.objecter ms_handle_connect 0x7f392015b3a0 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.781+0000 7f39157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.782+0000 7f39157fa640 10 client.?.objecter ms_handle_connect 0x7f3920163890 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.782+0000 7f39157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261110822 0 0) 0x7f39201fbab0 con 0x7f3920163890 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 10 monclient(hunting): my global_id is 4121 2026-02-25T15:00:33.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.784+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38f0003610 con 0x7f3920163890 2026-02-25T15:00:33.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 906068570 0 0) 0x7f38f0003610 con 0x7f3920163890 2026-02-25T15:00:33.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f39201fbab0 con 0x7f3920163890 2026-02-25T15:00:33.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f391c003710 con 0x7f3920163890 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 10 monclient(hunting): dump: 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.794 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.795 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.787+0000 7f39157fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:33.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 483968507 0 0) 0x7f39201fbab0 con 0x7f3920163890 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 >> v1:10.20.193.31:6789/0 conn(0x7f392015b3a0 legacy=0x7f392005cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 >> v1:10.20.193.21:6789/0 conn(0x7f392015afd0 legacy=0x7f3920056fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 10 monclient: _finish_hunting 0 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 1 monclient: found mon.c 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39201fbd90 con 0x7f3920163890 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 10 monclient: _finish_auth 0 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 10 monclient: _check_auth_tickets 2026-02-25T15:00:33.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f39157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 5 monclient: authenticate success, global_id 4121 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 10 monclient: _renew_subs 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f39201fc070 con 0x7f3920163890 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 10 client.4121.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 10 monclient: _renew_subs 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f39201fb450 con 0x7f3920163890 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.810+0000 7f3926d13640 1 librados: init done 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.811+0000 7f3926d13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.811+0000 7f3926d13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.811+0000 7f3926d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.816 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.811+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39201fc2b0 con 0x7f3920163890 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f391c003330 con 0x7f3920163890 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f391c0050e0 con 0x7f3920163890 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f3916ffd640 4 set_mon_vals no callback set 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.874+0000 7f39157fa640 10 monclient: dump: 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:33.878 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f391c0056d0 con 0x7f3920163890 2026-02-25T15:00:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 2181459385 0 0) 0x7f391c006f50 con 0x7f3920163890 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 10 client.4121.objecter ms_dispatch2 0x7f3920000b90 osd_map(1..1 src has 1..1) 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 3 client.4121.objecter handle_osd_map got epochs [1,1] > 0 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 3 client.4121.objecter handle_osd_map decoding full epoch 1 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.876+0000 7f39157fa640 20 client.4121.objecter dump_active .. 0 homeless 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.877+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f391c0072b0 con 0x7f3920163890 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.877+0000 7f39157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.877+0000 7f39157fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:33.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.907+0000 7f3926d13640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:00:33.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.907+0000 7f3926d13640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:00:33.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.907+0000 7f3926d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:33.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.907+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f3920058330 con 0x7f3920163890 2026-02-25T15:00:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.992+0000 7f39157fa640 1 -- 10.20.193.21:0/1469323525 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f391c005da0 con 0x7f3920163890 2026-02-25T15:00:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.992+0000 7f39157fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-25T15:00:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.992+0000 7f39157fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-25T15:00:33.995 INFO:teuthology.orchestra.run.trial021.stderr:adjusted tunables profile to default 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 10 librados: watch_flush enter 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 10 librados: watch_flush exit 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 20 client.4121.objecter shutdown clearing up homeless session... 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 10 client.4121.objecter successfully canceled tick 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 10 monclient: shutdown 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 >> v1:10.20.193.68:6789/0 conn(0x7f3920163890 legacy=0x7f39201fdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 shutdown_connections 2026-02-25T15:00:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 >> 10.20.193.21:0/1469323525 conn(0x7f39200b2f10 msgr2=0x7f39200b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 shutdown_connections 2026-02-25T15:00:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 -- 10.20.193.21:0/1469323525 wait complete. 2026-02-25T15:00:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:33.993+0000 7f3926d13640 1 librados: shutdown 2026-02-25T15:00:34.005 INFO:tasks.ceph:check_enable_crimson: False 2026-02-25T15:00:34.005 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-25T15:00:34.006 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:34.006 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-25T15:00:34.030 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:34.030 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-25T15:00:34.094 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:34.094 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-25T15:00:34.159 DEBUG:teuthology.orchestra.run.trial021:> set -ex 2026-02-25T15:00:34.159 DEBUG:teuthology.orchestra.run.trial021:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-25T15:00:34.225 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:34.226 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-25T15:00:34.253 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:34.253 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-25T15:00:34.281 INFO:tasks.ceph.mgr.x.trial072.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-25T15:00:34.281 INFO:tasks.ceph.mgr.x.trial072.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-25T15:00:34.281 INFO:tasks.ceph.mgr.x.trial072.stderr: from numpy import show_config as show_numpy_config 2026-02-25T15:00:34.318 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:34.318 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-25T15:00:34.338 INFO:tasks.ceph.mgr.y.trial021.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-25T15:00:34.338 INFO:tasks.ceph.mgr.y.trial021.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-25T15:00:34.338 INFO:tasks.ceph.mgr.y.trial021.stderr: from numpy import show_config as show_numpy_config 2026-02-25T15:00:34.381 DEBUG:teuthology.orchestra.run.trial031:> set -ex 2026-02-25T15:00:34.382 DEBUG:teuthology.orchestra.run.trial031:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-25T15:00:34.446 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:34.446 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-25T15:00:34.473 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:34.474 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-25T15:00:34.538 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:34.539 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-25T15:00:34.602 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-25T15:00:34.603 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-25T15:00:34.667 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:34.668 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-25T15:00:34.693 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:34.694 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-25T15:00:34.758 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:34.758 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-25T15:00:34.823 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:00:34.823 DEBUG:teuthology.orchestra.run.trial072:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-25T15:00:34.889 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new dace5762-92f4-44c8-bdc3-79eeb83edabf 0 2026-02-25T15:00:34.995 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.992+0000 7ff0e7567640 10 monclient: get_monmap_and_config 2026-02-25T15:00:34.995 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.992+0000 7ff0e7567640 10 monclient: build_initial_monmap 2026-02-25T15:00:34.995 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.992+0000 7ff0e7567640 10 monclient: monmap: 2026-02-25T15:00:34.995 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:34.993441+0000 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:34.993441+0000 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 1 Processor -- start 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 1 -- start start 2026-02-25T15:00:34.996 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient: init 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-c con 0x7ff0e011e790 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-b con 0x7ff0e01406c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-a con 0x7ff0e0162250 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e0183fe0 con 0x7ff0e0162250 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e01851e0 con 0x7ff0e01406c0 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e01863e0 con 0x7ff0e011e790 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e7567640 10 monclient(hunting): authenticate will time out at 2980.727386s 2026-02-25T15:00:34.997 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e5add640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff0e0162250 0x7ff0e01826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51140/0 (socket says 10.20.193.72:51140) 2026-02-25T15:00:34.998 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.993+0000 7ff0e5add640 1 -- 10.20.193.72:0/241101387 learned_addr learned my addr 10.20.193.72:0/241101387 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305669859 0 0) 0x7ff0e01851e0 con 0x7ff0e01406c0 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): my global_id is 4117 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0c8003610 con 0x7ff0e01406c0 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899571249 0 0) 0x7ff0e0183fe0 con 0x7ff0e0162250 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.003 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): my global_id is 4116 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e01851e0 con 0x7ff0e0162250 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736057938 0 0) 0x7ff0e01863e0 con 0x7ff0e011e790 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 10 monclient(hunting): my global_id is 4124 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.995+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e0183fe0 con 0x7ff0e011e790 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2671881173 0 0) 0x7ff0e01851e0 con 0x7ff0e0162250 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 >> v1:10.20.193.68:6789/0 conn(0x7ff0e011e790 legacy=0x7ff0e011eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 >> v1:10.20.193.31:6789/0 conn(0x7ff0e01406c0 legacy=0x7ff0e0160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.004 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 monclient: found mon.noname-a 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e0187680 con 0x7ff0e0162250 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0dc003170 con 0x7ff0e0162250 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0cffff640 10 monclient: dump: 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.005 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0e7567640 5 monclient: authenticate success, global_id 4116 2026-02-25T15:00:35.006 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.997+0000 7ff0e7567640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0dc0033b0 con 0x7ff0e0162250 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 1 -- 10.20.193.72:0/241101387 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0dc0037f0 con 0x7ff0e0162250 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0cffff640 10 monclient: dump: 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.007 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0e7567640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.998+0000 7ff0e7567640 4 set_mon_vals no callback set 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: shutdown 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- 10.20.193.72:0/241101387 >> v1:10.20.193.21:6789/0 conn(0x7ff0e0162250 legacy=0x7ff0e01826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- 10.20.193.72:0/241101387 shutdown_connections 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- 10.20.193.72:0/241101387 >> 10.20.193.72:0/241101387 conn(0x7ff0e00588d0 msgr2=0x7ff0e0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.008 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- 10.20.193.72:0/241101387 shutdown_connections 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- 10.20.193.72:0/241101387 wait complete. 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: monmap: 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.009 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 librados: starting msgr at 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 librados: starting objecter 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 Processor -- start 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- start start 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 librados: setting wanted keys 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 librados: calling monclient init 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: init 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-c con 0x7ff0e011e790 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-a con 0x7ff0e01406c0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.010 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient(hunting): picked mon.noname-b con 0x7ff0e0162250 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e012e5b0 con 0x7ff0e01406c0 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e012f7b0 con 0x7ff0e0162250 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e01309b0 con 0x7ff0e011e790 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:34.999+0000 7ff0e7567640 10 monclient(hunting): authenticate will time out at 2980.733782s 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0e4adb640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff0e01406c0 0x7ff0e0160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51146/0 (socket says 10.20.193.72:51146) 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0e4adb640 1 -- 10.20.193.72:0/3017980108 learned_addr learned my addr 10.20.193.72:0/3017980108 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter ms_handle_connect 0x7ff0e01406c0 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter ms_handle_connect 0x7ff0e0162250 2026-02-25T15:00:35.011 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter ms_handle_connect 0x7ff0e011e790 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.000+0000 7ff0cdffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000720091 0 0) 0x7ff0e012e5b0 con 0x7ff0e01406c0 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): my global_id is 4119 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b0003610 con 0x7ff0e01406c0 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513057351 0 0) 0x7ff0e01309b0 con 0x7ff0e011e790 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.012 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): my global_id is 4127 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e012e5b0 con 0x7ff0e011e790 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214760438 0 0) 0x7ff0e012f7b0 con 0x7ff0e0162250 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 10 monclient(hunting): my global_id is 4120 2026-02-25T15:00:35.013 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.001+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0e01309b0 con 0x7ff0e0162250 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2850720648 0 0) 0x7ff0b0003610 con 0x7ff0e01406c0 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0e012f7b0 con 0x7ff0e01406c0 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0d40030f0 con 0x7ff0e01406c0 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.017 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1633221577 0 0) 0x7ff0e012e5b0 con 0x7ff0e011e790 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0b0003610 con 0x7ff0e011e790 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0d0003060 con 0x7ff0e011e790 2026-02-25T15:00:35.018 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.003+0000 7ff0cdffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.019 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3008199306 0 0) 0x7ff0e01309b0 con 0x7ff0e0162250 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0e012e5b0 con 0x7ff0e0162250 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0dc003700 con 0x7ff0e0162250 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.004+0000 7ff0cdffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.020 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3657931163 0 0) 0x7ff0e012f7b0 con 0x7ff0e01406c0 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 >> v1:10.20.193.68:6789/0 conn(0x7ff0e011e790 legacy=0x7ff0e01826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 >> v1:10.20.193.31:6789/0 conn(0x7ff0e0162250 legacy=0x7ff0e012cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 1 monclient: found mon.a 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.021 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e0131c50 con 0x7ff0e01406c0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 5 monclient: authenticate success, global_id 4119 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _renew_subs 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e012f9e0 con 0x7ff0e01406c0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _renew_subs 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0e0130020 con 0x7ff0e01406c0 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 1 librados: init done 2026-02-25T15:00:35.022 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.005+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e0185740 con 0x7ff0e01406c0 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0d40034a0 con 0x7ff0e01406c0 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff0d4003b50 con 0x7ff0e01406c0 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cdffb640 10 monclient: dump: 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.023 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.006+0000 7ff0cf7fe640 4 set_mon_vals no callback set 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7ff0d4004140 con 0x7ff0e01406c0 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 2007649951 0 0) 0x7ff0d40069a0 con 0x7ff0e01406c0 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 10 client.4119.objecter ms_dispatch2 0x7ff0e0000b90 osd_map(2..2 src has 1..2) 2026-02-25T15:00:35.024 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 3 client.4119.objecter handle_osd_map got epochs [2,2] > 0 2026-02-25T15:00:35.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 3 client.4119.objecter handle_osd_map decoding full epoch 2 2026-02-25T15:00:35.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.007+0000 7ff0cdffb640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-25T15:00:35.036 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.035+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7ff0d4004460 con 0x7ff0e01406c0 2026-02-25T15:00:35.036 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.035+0000 7ff0cdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.037 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.035+0000 7ff0cdffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:35.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.068+0000 7ff0e7567640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dace5762-92f4-44c8-bdc3-79eeb83edabf", "id": 0}] 2026-02-25T15:00:35.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.068+0000 7ff0e7567640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dace5762-92f4-44c8-bdc3-79eeb83edabf", "id": 0}] 2026-02-25T15:00:35.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.068+0000 7ff0e7567640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.068+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd new", "uuid": "dace5762-92f4-44c8-bdc3-79eeb83edabf", "id": 0} v 0) -- 0x7ff0e0130310 con 0x7ff0e01406c0 2026-02-25T15:00:35.158 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.156+0000 7ff0cdffb640 1 -- 10.20.193.72:0/3017980108 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dace5762-92f4-44c8-bdc3-79eeb83edabf", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3332830912 0 732707515) 0x7ff0d40058b0 con 0x7ff0e01406c0 2026-02-25T15:00:35.158 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.156+0000 7ff0cdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dace5762-92f4-44c8-bdc3-79eeb83edabf", "id": 0}] 2026-02-25T15:00:35.158 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.156+0000 7ff0cdffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:35.158 INFO:teuthology.orchestra.run.trial072.stdout:0 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 10 librados: watch_flush enter 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 10 librados: watch_flush exit 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 10 client.4119.objecter successfully canceled tick 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 10 monclient: shutdown 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 >> v1:10.20.193.21:6789/0 conn(0x7ff0e01406c0 legacy=0x7ff0e0160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 shutdown_connections 2026-02-25T15:00:35.160 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 >> 10.20.193.72:0/3017980108 conn(0x7ff0e00588d0 msgr2=0x7ff0e011d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.161 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 shutdown_connections 2026-02-25T15:00:35.161 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 -- 10.20.193.72:0/3017980108 wait complete. 2026-02-25T15:00:35.161 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.157+0000 7ff0e7567640 1 librados: shutdown 2026-02-25T15:00:35.168 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 5c83bd4f-2319-4fd7-82f0-610e641cdc07 1 2026-02-25T15:00:35.234 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 10 monclient: get_monmap_and_config 2026-02-25T15:00:35.234 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.234 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 10 monclient: monmap: 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:35.234072+0000 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:35.234072+0000 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.235 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 1 Processor -- start 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 1 -- start start 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 10 monclient: init 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.233+0000 7f874a8d1640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-b con 0x7f8744121d90 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-a con 0x7f8744142a00 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-c con 0x7f8744164710 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87441864c0 con 0x7f8744142a00 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87441876c0 con 0x7f8744121d90 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87441888c0 con 0x7f8744164710 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f874a8d1640 10 monclient(hunting): authenticate will time out at 2980.968071s 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f8743fff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f8744121d90 0x7f8744122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55004/0 (socket says 10.20.193.72:55004) 2026-02-25T15:00:35.236 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.234+0000 7f8743fff640 1 -- 10.20.193.72:0/1808165152 learned_addr learned my addr 10.20.193.72:0/1808165152 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910655952 0 0) 0x7f87441888c0 con 0x7f8744164710 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): my global_id is 4130 2026-02-25T15:00:35.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8728003610 con 0x7f8744164710 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740351362 0 0) 0x7f87441876c0 con 0x7f8744121d90 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 10 monclient(hunting): my global_id is 4123 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.235+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87441888c0 con 0x7f8744121d90 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884181329 0 0) 0x7f87441864c0 con 0x7f8744142a00 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 10 monclient(hunting): my global_id is 4122 2026-02-25T15:00:35.238 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.236+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87441876c0 con 0x7f8744142a00 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2861976909 0 0) 0x7f8728003610 con 0x7f8744164710 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 >> v1:10.20.193.31:6789/0 conn(0x7f8744121d90 legacy=0x7f8744122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 >> v1:10.20.193.21:6789/0 conn(0x7f8744142a00 legacy=0x7f8744162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 monclient: found mon.noname-c 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.241 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8744189b60 con 0x7f8744164710 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f87380030a0 con 0x7f8744164710 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f8742ffd640 10 monclient: dump: 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.242 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f874a8d1640 5 monclient: authenticate success, global_id 4130 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.237+0000 7f874a8d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87380032e0 con 0x7f8744164710 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 1 -- 10.20.193.72:0/1808165152 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8738003720 con 0x7f8744164710 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f8742ffd640 10 monclient: dump: 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.243 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 4 set_mon_vals no callback set 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 10 monclient: shutdown 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 1 -- 10.20.193.72:0/1808165152 >> v1:10.20.193.68:6789/0 conn(0x7f8744164710 legacy=0x7f8744184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 1 -- 10.20.193.72:0/1808165152 shutdown_connections 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 1 -- 10.20.193.72:0/1808165152 >> 10.20.193.72:0/1808165152 conn(0x7f8744057490 msgr2=0x7f8744057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 1 -- 10.20.193.72:0/1808165152 shutdown_connections 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.238+0000 7f874a8d1640 1 -- 10.20.193.72:0/1808165152 wait complete. 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.244 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient: monmap: 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 librados: starting msgr at 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 librados: starting objecter 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 Processor -- start 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 -- start start 2026-02-25T15:00:35.245 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 librados: setting wanted keys 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 librados: calling monclient init 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient: init 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-b con 0x7f8744121d90 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-c con 0x7f8744142a00 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient(hunting): picked mon.noname-a con 0x7f8744164710 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874411c8e0 con 0x7f8744164710 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874411cab0 con 0x7f8744121d90 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f874411cc80 con 0x7f8744142a00 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f874a8d1640 10 monclient(hunting): authenticate will time out at 2980.973397s 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f8748e47640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f8744164710 0x7f874411c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51178/0 (socket says 10.20.193.72:51178) 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f8748e47640 1 -- 10.20.193.72:0/1985802604 learned_addr learned my addr 10.20.193.72:0/1985802604 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.246 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f8740ff9640 10 client.?.objecter ms_handle_connect 0x7f8744164710 2026-02-25T15:00:35.247 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.239+0000 7f8740ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.247 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 client.?.objecter ms_handle_connect 0x7f8744121d90 2026-02-25T15:00:35.247 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.247 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 client.?.objecter ms_handle_connect 0x7f8744142a00 2026-02-25T15:00:35.247 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.250 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810370742 0 0) 0x7f874411c8e0 con 0x7f8744164710 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 10 monclient(hunting): my global_id is 4125 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.240+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8714003610 con 0x7f8744164710 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554442186 0 0) 0x7f874411cab0 con 0x7f8744121d90 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): my global_id is 4126 2026-02-25T15:00:35.251 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f874411c8e0 con 0x7f8744121d90 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750819432 0 0) 0x7f874411cc80 con 0x7f8744142a00 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 10 monclient(hunting): my global_id is 4133 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.241+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f874411cab0 con 0x7f8744142a00 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1594142014 0 0) 0x7f874411c8e0 con 0x7f8744121d90 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f874411cc80 con 0x7f8744121d90 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f87300030b0 con 0x7f8744121d90 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): dump: 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.252 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3329462961 0 0) 0x7f874411cab0 con 0x7f8744142a00 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f874411c8e0 con 0x7f8744142a00 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8734003090 con 0x7f8744142a00 2026-02-25T15:00:35.253 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): dump: 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3111258129 0 0) 0x7f8714003610 con 0x7f8744164710 2026-02-25T15:00:35.254 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f874411cab0 con 0x7f8744164710 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8738002fb0 con 0x7f8744164710 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.243+0000 7f8740ff9640 10 monclient(hunting): dump: 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.255 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.244+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3309062436 0 0) 0x7f874411c8e0 con 0x7f8744142a00 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 >> v1:10.20.193.31:6789/0 conn(0x7f8744121d90 legacy=0x7f8744184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 >> v1:10.20.193.21:6789/0 conn(0x7f8744164710 legacy=0x7f874411c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 1 monclient: found mon.c 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874411ce50 con 0x7f8744142a00 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.256 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f8740ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 5 monclient: authenticate success, global_id 4133 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _renew_subs 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f874414ffa0 con 0x7f8744142a00 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 client.4133.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _renew_subs 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f87441505e0 con 0x7f8744142a00 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 1 librados: init done 2026-02-25T15:00:35.257 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.245+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87441869e0 con 0x7f8744142a00 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8734003700 con 0x7f8744142a00 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8734003a50 con 0x7f8744142a00 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f8740ff9640 10 monclient: dump: 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.258 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.246+0000 7f87427fc640 4 set_mon_vals no callback set 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f8734004000 con 0x7f8744142a00 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 4090866729 0 0) 0x7f8734005710 con 0x7f8744142a00 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 10 client.4133.objecter ms_dispatch2 0x7f8744000b90 osd_map(3..3 src has 1..3) 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 3 client.4133.objecter handle_osd_map got epochs [3,3] > 0 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 3 client.4133.objecter handle_osd_map decoding full epoch 3 2026-02-25T15:00:35.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.247+0000 7f8740ff9640 20 client.4133.objecter dump_active .. 0 homeless 2026-02-25T15:00:35.277 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.275+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f8734005b00 con 0x7f8744142a00 2026-02-25T15:00:35.277 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.275+0000 7f8740ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.277 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.275+0000 7f8740ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:35.309 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.308+0000 7f874a8d1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5c83bd4f-2319-4fd7-82f0-610e641cdc07", "id": 1}] 2026-02-25T15:00:35.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.308+0000 7f874a8d1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5c83bd4f-2319-4fd7-82f0-610e641cdc07", "id": 1}] 2026-02-25T15:00:35.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.308+0000 7f874a8d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.308+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5c83bd4f-2319-4fd7-82f0-610e641cdc07", "id": 1} v 0) -- 0x7f8744186bb0 con 0x7f8744142a00 2026-02-25T15:00:35.332 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f8740ff9640 1 -- 10.20.193.72:0/1985802604 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c83bd4f-2319-4fd7-82f0-610e641cdc07", "id": 1}]=0 v4) ==== 112+0+2 (unknown 4236531981 0 940483276) 0x7f8744186bb0 con 0x7f8744142a00 2026-02-25T15:00:35.332 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f8740ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5c83bd4f-2319-4fd7-82f0-610e641cdc07", "id": 1}] 2026-02-25T15:00:35.332 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f8740ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:35.332 INFO:teuthology.orchestra.run.trial072.stdout:1 2026-02-25T15:00:35.332 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 10 librados: watch_flush enter 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 10 librados: watch_flush exit 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 20 client.4133.objecter shutdown clearing up homeless session... 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 10 client.4133.objecter successfully canceled tick 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 10 monclient: shutdown 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 >> v1:10.20.193.68:6789/0 conn(0x7f8744142a00 legacy=0x7f8744148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 shutdown_connections 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 >> 10.20.193.72:0/1985802604 conn(0x7f8744057490 msgr2=0x7f8744163550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 shutdown_connections 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 -- 10.20.193.72:0/1985802604 wait complete. 2026-02-25T15:00:35.333 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.331+0000 7f874a8d1640 1 librados: shutdown 2026-02-25T15:00:35.340 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new e759c1bc-5b57-44ef-8aac-43af8ba53901 2 2026-02-25T15:00:35.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: get_monmap_and_config 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: monmap: 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:35.404084+0000 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:35.404084+0000 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.406 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 1 Processor -- start 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 1 -- start start 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: init 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-c con 0x7f3e2811c500 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-a con 0x7f3e2811e420 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2811ffc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28120d10 con 0x7f3e2811e420 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28120f00 con 0x7f3e2811ffc0 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e281210f0 con 0x7f3e2811c500 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.403+0000 7f3e2f544640 10 monclient(hunting): authenticate will time out at 2981.137983s 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.404+0000 7f3e2daba640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3e2811ffc0 0x7f3e28120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55018/0 (socket says 10.20.193.72:55018) 2026-02-25T15:00:35.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.404+0000 7f3e2daba640 1 -- 10.20.193.72:0/3400523901 learned_addr learned my addr 10.20.193.72:0/3400523901 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.410 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843633167 0 0) 0x7f3e28120f00 con 0x7f3e2811ffc0 2026-02-25T15:00:35.410 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.410 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.410 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): my global_id is 4129 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e10003610 con 0x7f3e2811ffc0 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903655949 0 0) 0x7f3e281210f0 con 0x7f3e2811c500 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 10 monclient(hunting): my global_id is 4136 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.405+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e28120f00 con 0x7f3e2811c500 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527554527 0 0) 0x7f3e28120d10 con 0x7f3e2811e420 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.411 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 10 monclient(hunting): my global_id is 4128 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.406+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e281210f0 con 0x7f3e2811e420 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1061579815 0 0) 0x7f3e10003610 con 0x7f3e2811ffc0 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 >> v1:10.20.193.68:6789/0 conn(0x7f3e2811c500 legacy=0x7f3e2811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 >> v1:10.20.193.21:6789/0 conn(0x7f3e2811e420 legacy=0x7f3e2811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 monclient: found mon.noname-b 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e28121380 con 0x7f3e2811ffc0 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.412 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e24003170 con 0x7f3e2811ffc0 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e17fff640 10 monclient: dump: 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.413 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.414 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.414 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.414 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e2f544640 5 monclient: authenticate success, global_id 4129 2026-02-25T15:00:35.414 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.407+0000 7f3e2f544640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e240033b0 con 0x7f3e2811ffc0 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 1 -- 10.20.193.72:0/3400523901 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e240037f0 con 0x7f3e2811ffc0 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 4 set_mon_vals no callback set 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e17fff640 10 monclient: dump: 2026-02-25T15:00:35.426 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 10 monclient: shutdown 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 1 -- 10.20.193.72:0/3400523901 >> v1:10.20.193.31:6789/0 conn(0x7f3e2811ffc0 legacy=0x7f3e28120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 1 -- 10.20.193.72:0/3400523901 shutdown_connections 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 1 -- 10.20.193.72:0/3400523901 >> 10.20.193.72:0/3400523901 conn(0x7f3e280588d0 msgr2=0x7f3e28058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 1 -- 10.20.193.72:0/3400523901 shutdown_connections 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.421+0000 7f3e2f544640 1 -- 10.20.193.72:0/3400523901 wait complete. 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient: monmap: 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.428 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 librados: starting msgr at 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 librados: starting objecter 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 Processor -- start 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 -- start start 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 librados: setting wanted keys 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 librados: calling monclient init 2026-02-25T15:00:35.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient: init 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-a con 0x7f3e2811c500 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-b con 0x7f3e2811e420 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient(hunting): picked mon.noname-c con 0x7f3e2811ffc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e28179860 con 0x7f3e2811c500 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2817aa40 con 0x7f3e2811e420 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2817bc20 con 0x7f3e2811ffc0 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2f544640 10 monclient(hunting): authenticate will time out at 2981.156324s 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2daba640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3e2811ffc0 0x7f3e28178140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:58218/0 (socket says 10.20.193.72:58218) 2026-02-25T15:00:35.430 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e2daba640 1 -- 10.20.193.72:0/1674505547 learned_addr learned my addr 10.20.193.72:0/1674505547 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e15ffb640 10 client.?.objecter ms_handle_connect 0x7f3e2811ffc0 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.422+0000 7f3e15ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.423+0000 7f3e15ffb640 10 client.?.objecter ms_handle_connect 0x7f3e2811c500 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.423+0000 7f3e15ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.423+0000 7f3e15ffb640 10 client.?.objecter ms_handle_connect 0x7f3e2811e420 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.423+0000 7f3e15ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588877326 0 0) 0x7f3e2817bc20 con 0x7f3e2811ffc0 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): my global_id is 4139 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df8003610 con 0x7f3e2811ffc0 2026-02-25T15:00:35.431 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68313840 0 0) 0x7f3e2817aa40 con 0x7f3e2811e420 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): my global_id is 4132 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e2817bc20 con 0x7f3e2811e420 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249674263 0 0) 0x7f3e28179860 con 0x7f3e2811c500 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 10 monclient(hunting): my global_id is 4131 2026-02-25T15:00:35.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.424+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e2817aa40 con 0x7f3e2811c500 2026-02-25T15:00:35.435 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668607017 0 0) 0x7f3df8003610 con 0x7f3e2811ffc0 2026-02-25T15:00:35.435 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e28179860 con 0x7f3e2811ffc0 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e24003560 con 0x7f3e2811ffc0 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.436 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2554834938 0 0) 0x7f3e2817bc20 con 0x7f3e2811e420 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3df8003610 con 0x7f3e2811e420 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e1c003060 con 0x7f3e2811e420 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.426+0000 7f3e15ffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.437 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3771529368 0 0) 0x7f3e2817aa40 con 0x7f3e2811c500 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e2817bc20 con 0x7f3e2811c500 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e18003070 con 0x7f3e2811c500 2026-02-25T15:00:35.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient(hunting): dump: 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2716860180 0 0) 0x7f3e28179860 con 0x7f3e2811ffc0 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 >> v1:10.20.193.31:6789/0 conn(0x7f3e2811e420 legacy=0x7f3e28176a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 >> v1:10.20.193.21:6789/0 conn(0x7f3e2811c500 legacy=0x7f3e28130020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 monclient: found mon.c 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2817ce00 con 0x7f3e2811ffc0 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 5 monclient: authenticate success, global_id 4139 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 10 monclient: _renew_subs 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e28179a30 con 0x7f3e2811ffc0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 10 client.4139.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 10 monclient: _renew_subs 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e2817a070 con 0x7f3e2811ffc0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.427+0000 7f3e2f544640 1 librados: init done 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.428+0000 7f3e2f544640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.428+0000 7f3e2f544640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.428+0000 7f3e2f544640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.428+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2818b560 con 0x7f3e2811ffc0 2026-02-25T15:00:35.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e24003870 con 0x7f3e2811ffc0 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3e24005060 con 0x7f3e2811ffc0 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e15ffb640 10 monclient: dump: 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.442 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.429+0000 7f3e177fe640 4 set_mon_vals no callback set 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f3e24005610 con 0x7f3e2811ffc0 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 2838521657 0 0) 0x7f3e24006c50 con 0x7f3e2811ffc0 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 10 client.4139.objecter ms_dispatch2 0x7f3e28000b90 osd_map(4..4 src has 1..4) 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 3 client.4139.objecter handle_osd_map got epochs [4,4] > 0 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 3 client.4139.objecter handle_osd_map decoding full epoch 4 2026-02-25T15:00:35.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.430+0000 7f3e15ffb640 20 client.4139.objecter dump_active .. 0 homeless 2026-02-25T15:00:35.462 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.460+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f3e240068e0 con 0x7f3e2811ffc0 2026-02-25T15:00:35.462 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.460+0000 7f3e15ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.462 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.460+0000 7f3e15ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:35.495 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.493+0000 7f3e2f544640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e759c1bc-5b57-44ef-8aac-43af8ba53901", "id": 2}] 2026-02-25T15:00:35.495 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.493+0000 7f3e2f544640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e759c1bc-5b57-44ef-8aac-43af8ba53901", "id": 2}] 2026-02-25T15:00:35.495 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.493+0000 7f3e2f544640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.495 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.493+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e759c1bc-5b57-44ef-8aac-43af8ba53901", "id": 2} v 0) -- 0x7f3e2817a760 con 0x7f3e2811ffc0 2026-02-25T15:00:35.521 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e15ffb640 1 -- 10.20.193.72:0/1674505547 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e759c1bc-5b57-44ef-8aac-43af8ba53901", "id": 2}]=0 v5) ==== 112+0+2 (unknown 3196996424 0 216599125) 0x7f3e24005930 con 0x7f3e2811ffc0 2026-02-25T15:00:35.521 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e15ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e759c1bc-5b57-44ef-8aac-43af8ba53901", "id": 2}] 2026-02-25T15:00:35.522 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e15ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:35.522 INFO:teuthology.orchestra.run.trial072.stdout:2 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 10 librados: watch_flush enter 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 10 librados: watch_flush exit 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 20 client.4139.objecter shutdown clearing up homeless session... 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 10 client.4139.objecter successfully canceled tick 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 10 monclient: shutdown 2026-02-25T15:00:35.523 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.520+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 >> v1:10.20.193.68:6789/0 conn(0x7f3e2811ffc0 legacy=0x7f3e28178140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.521+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 shutdown_connections 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.521+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 >> 10.20.193.72:0/1674505547 conn(0x7f3e280588d0 msgr2=0x7f3e28059080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.521+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 shutdown_connections 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.521+0000 7f3e2f544640 1 -- 10.20.193.72:0/1674505547 wait complete. 2026-02-25T15:00:35.524 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.521+0000 7f3e2f544640 1 librados: shutdown 2026-02-25T15:00:35.531 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 9f6295a8-a84b-431a-887b-fe1fcc8b4fa7 3 2026-02-25T15:00:35.598 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: get_monmap_and_config 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: monmap: 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:35.596876+0000 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:35.596876+0000 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.599 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 1 Processor -- start 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 1 -- start start 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: init 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-a con 0x7f087811c500 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-b con 0x7f087811e420 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-c con 0x7f087811ffc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0878120d10 con 0x7f087811c500 2026-02-25T15:00:35.600 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0878120f00 con 0x7f087811e420 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08781210f0 con 0x7f087811ffc0 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.596+0000 7f087cf08640 10 monclient(hunting): authenticate will time out at 2981.330772s 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.597+0000 7f0876d76640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f087811ffc0 0x7f0878120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:58234/0 (socket says 10.20.193.72:58234) 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.597+0000 7f0876d76640 1 -- 10.20.193.72:0/2288152680 learned_addr learned my addr 10.20.193.72:0/2288152680 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.601 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.597+0000 7f0876575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f087811c500 0x7f087811c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51204/0 (socket says 10.20.193.72:51204) 2026-02-25T15:00:35.607 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1119565342 0 0) 0x7f08781210f0 con 0x7f087811ffc0 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): my global_id is 4142 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0864003610 con 0x7f087811ffc0 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472357218 0 0) 0x7f0878120f00 con 0x7f087811e420 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.608 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): my global_id is 4135 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08781210f0 con 0x7f087811e420 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355456757 0 0) 0x7f0878120d10 con 0x7f087811c500 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 10 monclient(hunting): my global_id is 4134 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.598+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0878120f00 con 0x7f087811c500 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703252151 0 0) 0x7f0864003610 con 0x7f087811ffc0 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 >> v1:10.20.193.31:6789/0 conn(0x7f087811e420 legacy=0x7f087811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 >> v1:10.20.193.21:6789/0 conn(0x7f087811c500 legacy=0x7f087811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 monclient: found mon.noname-c 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0878121380 con 0x7f087811ffc0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f087cf08640 5 monclient: authenticate success, global_id 4142 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f087cf08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0868003170 con 0x7f087811ffc0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f0875573640 10 monclient: dump: 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.611 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.600+0000 7f087cf08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0868003430 con 0x7f087811ffc0 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 1 -- 10.20.193.72:0/2288152680 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0868003830 con 0x7f087811ffc0 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f0875573640 10 monclient: dump: 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.612 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 4 set_mon_vals no callback set 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 10 monclient: shutdown 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- 10.20.193.72:0/2288152680 >> v1:10.20.193.68:6789/0 conn(0x7f087811ffc0 legacy=0x7f0878120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- 10.20.193.72:0/2288152680 shutdown_connections 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- 10.20.193.72:0/2288152680 >> 10.20.193.72:0/2288152680 conn(0x7f08780588d0 msgr2=0x7f0878058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- 10.20.193.72:0/2288152680 shutdown_connections 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- 10.20.193.72:0/2288152680 wait complete. 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 10 monclient: monmap: 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.614 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 librados: starting msgr at 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 librados: starting objecter 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 Processor -- start 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 -- start start 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 librados: setting wanted keys 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 1 librados: calling monclient init 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.601+0000 7f087cf08640 10 monclient: init 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-a con 0x7f087811c500 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-b con 0x7f087811e420 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.615 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient(hunting): picked mon.noname-c con 0x7f087811ffc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0878179830 con 0x7f087811c500 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087817aa10 con 0x7f087811e420 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f087817bbf0 con 0x7f087811ffc0 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f087cf08640 10 monclient(hunting): authenticate will time out at 2981.336098s 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f0875d74640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f087811e420 0x7f08781769f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55052/0 (socket says 10.20.193.72:55052) 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f0875d74640 1 -- 10.20.193.72:0/3203225529 learned_addr learned my addr 10.20.193.72:0/3203225529 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f085effd640 10 client.?.objecter ms_handle_connect 0x7f087811e420 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f085effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f085effd640 10 client.?.objecter ms_handle_connect 0x7f087811c500 2026-02-25T15:00:35.616 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.602+0000 7f085effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 client.?.objecter ms_handle_connect 0x7f087811ffc0 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038308291 0 0) 0x7f0878179830 con 0x7f087811c500 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): my global_id is 4137 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0844003610 con 0x7f087811c500 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681900389 0 0) 0x7f087817aa10 con 0x7f087811e420 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.617 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 10 monclient(hunting): my global_id is 4138 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.603+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0878179830 con 0x7f087811e420 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1050984547 0 0) 0x7f087817bbf0 con 0x7f087811ffc0 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 10 monclient(hunting): my global_id is 4145 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.604+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f087817aa10 con 0x7f087811ffc0 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 177706007 0 0) 0x7f0844003610 con 0x7f087811c500 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f087817bbf0 con 0x7f087811c500 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f086c003060 con 0x7f087811c500 2026-02-25T15:00:35.618 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 10 monclient(hunting): dump: 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.619 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.605+0000 7f085effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3918026843 0 0) 0x7f0878179830 con 0x7f087811e420 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0844003610 con 0x7f087811e420 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f08600030c0 con 0x7f087811e420 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 10 monclient(hunting): dump: 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.620 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.621 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.621 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.621 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.621 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.623 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 342098394 0 0) 0x7f087817aa10 con 0x7f087811ffc0 2026-02-25T15:00:35.623 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.606+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0878179830 con 0x7f087811ffc0 2026-02-25T15:00:35.623 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0868003130 con 0x7f087811ffc0 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient(hunting): dump: 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.624 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2740023981 0 0) 0x7f087817bbf0 con 0x7f087811c500 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 >> v1:10.20.193.68:6789/0 conn(0x7f087811ffc0 legacy=0x7f0878178110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 >> v1:10.20.193.31:6789/0 conn(0x7f087811e420 legacy=0x7f08781769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 monclient: found mon.a 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087817cdd0 con 0x7f087811c500 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.625 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f085effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 5 monclient: authenticate success, global_id 4137 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 10 monclient: _renew_subs 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0878179a00 con 0x7f087811c500 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 10 client.4137.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 10 monclient: _renew_subs 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0878179fc0 con 0x7f087811c500 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.607+0000 7f087cf08640 1 librados: init done 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.608+0000 7f087cf08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.608+0000 7f087cf08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.608+0000 7f087cf08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.626 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.608+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087817a420 con 0x7f087811c500 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f086c0048d0 con 0x7f087811c500 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f086c004c20 con 0x7f087811c500 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f085effd640 10 monclient: dump: 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.627 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.609+0000 7f0874d72640 4 set_mon_vals no callback set 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f086c0051d0 con 0x7f087811c500 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 2233127864 0 0) 0x7f086c006a10 con 0x7f087811c500 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 10 client.4137.objecter ms_dispatch2 0x7f0878000b90 osd_map(5..5 src has 1..5) 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 3 client.4137.objecter handle_osd_map got epochs [5,5] > 0 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 3 client.4137.objecter handle_osd_map decoding full epoch 5 2026-02-25T15:00:35.628 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.610+0000 7f085effd640 20 client.4137.objecter dump_active .. 0 homeless 2026-02-25T15:00:35.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.637+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f086c006690 con 0x7f087811c500 2026-02-25T15:00:35.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.637+0000 7f085effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.637+0000 7f085effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:35.671 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.670+0000 7f087cf08640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9f6295a8-a84b-431a-887b-fe1fcc8b4fa7", "id": 3}] 2026-02-25T15:00:35.672 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.670+0000 7f087cf08640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9f6295a8-a84b-431a-887b-fe1fcc8b4fa7", "id": 3}] 2026-02-25T15:00:35.672 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.670+0000 7f087cf08640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.672 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.670+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9f6295a8-a84b-431a-887b-fe1fcc8b4fa7", "id": 3} v 0) -- 0x7f087805d480 con 0x7f087811c500 2026-02-25T15:00:35.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.733+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 2716666185 0 0) 0x7f086c0054f0 con 0x7f087811c500 2026-02-25T15:00:35.863 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f085effd640 1 -- 10.20.193.72:0/3203225529 <== mon.0 v1:10.20.193.21:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f6295a8-a84b-431a-887b-fe1fcc8b4fa7", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3830899202 0 525046306) 0x7f086c018e00 con 0x7f087811c500 2026-02-25T15:00:35.863 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f085effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9f6295a8-a84b-431a-887b-fe1fcc8b4fa7", "id": 3}] 2026-02-25T15:00:35.863 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f085effd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:35.864 INFO:teuthology.orchestra.run.trial072.stdout:3 2026-02-25T15:00:35.864 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 10 librados: watch_flush enter 2026-02-25T15:00:35.864 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 10 librados: watch_flush exit 2026-02-25T15:00:35.864 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 20 client.4137.objecter shutdown clearing up homeless session... 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 10 client.4137.objecter successfully canceled tick 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 10 monclient: shutdown 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 >> v1:10.20.193.21:6789/0 conn(0x7f087811c500 legacy=0x7f087812fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 shutdown_connections 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 >> 10.20.193.72:0/3203225529 conn(0x7f08780588d0 msgr2=0x7f0878059040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 shutdown_connections 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 -- 10.20.193.72:0/3203225529 wait complete. 2026-02-25T15:00:35.865 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.862+0000 7f087cf08640 1 librados: shutdown 2026-02-25T15:00:35.871 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 8b44cddc-ab46-44b5-9e53-ff0aa8d1b538 4 2026-02-25T15:00:35.938 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: get_monmap_and_config 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: monmap: 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:35.936741+0000 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:35.936741+0000 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.939 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 1 Processor -- start 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 1 -- start start 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: init 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-a con 0x7fdc4005d9b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-b con 0x7fdc4005dd80 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-c con 0x7fdc401649b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4005e200 con 0x7fdc4005d9b0 2026-02-25T15:00:35.940 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc401874c0 con 0x7fdc4005dd80 2026-02-25T15:00:35.941 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc401886a0 con 0x7fdc401649b0 2026-02-25T15:00:35.941 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.941 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc47f44640 10 monclient(hunting): authenticate will time out at 2981.670676s 2026-02-25T15:00:35.941 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc45cb9640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fdc4005d9b0 0x7fdc4011b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51284/0 (socket says 10.20.193.72:51284) 2026-02-25T15:00:35.941 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.936+0000 7fdc45cb9640 1 -- 10.20.193.72:0/2364791163 learned_addr learned my addr 10.20.193.72:0/2364791163 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124224140 0 0) 0x7fdc4005e200 con 0x7fdc4005d9b0 2026-02-25T15:00:35.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): my global_id is 4143 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc28003610 con 0x7fdc4005d9b0 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893960799 0 0) 0x7fdc401874c0 con 0x7fdc4005dd80 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 10 monclient(hunting): my global_id is 4153 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.938+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc4005e200 con 0x7fdc4005dd80 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3337340285 0 0) 0x7fdc28003610 con 0x7fdc4005d9b0 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 >> v1:10.20.193.68:6789/0 conn(0x7fdc401649b0 legacy=0x7fdc40184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 >> v1:10.20.193.31:6789/0 conn(0x7fdc4005dd80 legacy=0x7fdc4011b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 monclient: found mon.noname-a 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc40189920 con 0x7fdc4005d9b0 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdc30002df0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc44cb7640 10 monclient: dump: 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.949 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc47f44640 5 monclient: authenticate success, global_id 4143 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.939+0000 7fdc47f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc30003070 con 0x7fdc4005d9b0 2026-02-25T15:00:35.950 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 1 -- 10.20.193.72:0/2364791163 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdc300034b0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc44cb7640 10 monclient: dump: 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.951 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc47f44640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc47f44640 4 set_mon_vals no callback set 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc47f44640 10 monclient: shutdown 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc47f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.940+0000 7fdc47f44640 1 -- 10.20.193.72:0/2364791163 >> v1:10.20.193.21:6789/0 conn(0x7fdc4005d9b0 legacy=0x7fdc4011b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- 10.20.193.72:0/2364791163 shutdown_connections 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- 10.20.193.72:0/2364791163 >> 10.20.193.72:0/2364791163 conn(0x7fdc400588d0 msgr2=0x7fdc40058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- 10.20.193.72:0/2364791163 shutdown_connections 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- 10.20.193.72:0/2364791163 wait complete. 2026-02-25T15:00:35.952 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient: build_initial_monmap 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient: monmap: 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 librados: starting msgr at 2026-02-25T15:00:35.953 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 librados: starting objecter 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 Processor -- start 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- start start 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 librados: setting wanted keys 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 librados: calling monclient init 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient: init 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-b con 0x7fdc4005d9b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-a con 0x7fdc4005dd80 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient(hunting): picked mon.noname-c con 0x7fdc401649b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:35.954 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc401021e0 con 0x7fdc4005dd80 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc401090c0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4010a2a0 con 0x7fdc401649b0 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc47f44640 10 monclient(hunting): authenticate will time out at 2981.675679s 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc454b8640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fdc4005dd80 0x7fdc40161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51288/0 (socket says 10.20.193.72:51288) 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.941+0000 7fdc454b8640 1 -- 10.20.193.72:0/2954435799 learned_addr learned my addr 10.20.193.72:0/2954435799 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 client.?.objecter ms_handle_connect 0x7fdc4005dd80 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 client.?.objecter ms_handle_connect 0x7fdc4005d9b0 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:35.955 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641098149 0 0) 0x7fdc401021e0 con 0x7fdc4005dd80 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.942+0000 7fdc2e7fc640 10 monclient(hunting): my global_id is 4146 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc10003610 con 0x7fdc4005dd80 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186705761 0 0) 0x7fdc401090c0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 10 monclient(hunting): my global_id is 4156 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.943+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc401021e0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3659700786 0 0) 0x7fdc10003610 con 0x7fdc4005dd80 2026-02-25T15:00:35.956 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc401090c0 con 0x7fdc4005dd80 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdc34003170 con 0x7fdc4005dd80 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): dump: 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.957 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2212879442 0 0) 0x7fdc401021e0 con 0x7fdc4005d9b0 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc10003610 con 0x7fdc4005d9b0 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdc30002d00 con 0x7fdc4005d9b0 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.945+0000 7fdc2e7fc640 10 monclient(hunting): dump: 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.958 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.959 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2204622400 0 0) 0x7fdc401090c0 con 0x7fdc4005dd80 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 >> v1:10.20.193.68:6789/0 conn(0x7fdc401649b0 legacy=0x7fdc401630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 >> v1:10.20.193.31:6789/0 conn(0x7fdc4005d9b0 legacy=0x7fdc401016d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 1 monclient: found mon.a 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4010b480 con 0x7fdc4005dd80 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 5 monclient: authenticate success, global_id 4146 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 10 monclient: _renew_subs 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc40109290 con 0x7fdc4005dd80 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 10 monclient: _renew_subs 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc40109880 con 0x7fdc4005dd80 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.946+0000 7fdc47f44640 1 librados: init done 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.947+0000 7fdc47f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.947+0000 7fdc47f44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.947+0000 7fdc47f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:35.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.947+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc40187c10 con 0x7fdc4005dd80 2026-02-25T15:00:35.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc34003520 con 0x7fdc4005dd80 2026-02-25T15:00:35.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:35.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdc34003b50 con 0x7fdc4005dd80 2026-02-25T15:00:35.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:35.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 10 monclient: dump: 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:35.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2ffff640 4 set_mon_vals no callback set 2026-02-25T15:00:35.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.984+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 2716666185 0 0) 0x7fdc34003d30 con 0x7fdc4005dd80 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 2535517473 0 0) 0x7fdc34016c90 con 0x7fdc4005dd80 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 10 client.4146.objecter ms_dispatch2 0x7fdc40000b90 osd_map(6..6 src has 1..6) 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 3 client.4146.objecter handle_osd_map got epochs [6,6] > 0 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 3 client.4146.objecter handle_osd_map decoding full epoch 6 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 20 client.4146.objecter dump_active .. 0 homeless 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fdc34017a70 con 0x7fdc4005dd80 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:35.989 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:35.985+0000 7fdc2e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:36.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.018+0000 7fdc47f44640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8b44cddc-ab46-44b5-9e53-ff0aa8d1b538", "id": 4}] 2026-02-25T15:00:36.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.018+0000 7fdc47f44640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8b44cddc-ab46-44b5-9e53-ff0aa8d1b538", "id": 4}] 2026-02-25T15:00:36.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.018+0000 7fdc47f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:36.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.018+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8b44cddc-ab46-44b5-9e53-ff0aa8d1b538", "id": 4} v 0) -- 0x7fdc40109fd0 con 0x7fdc4005dd80 2026-02-25T15:00:36.085 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc2e7fc640 1 -- 10.20.193.72:0/2954435799 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b44cddc-ab46-44b5-9e53-ff0aa8d1b538", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2598886644 0 1697012583) 0x7fdc34017370 con 0x7fdc4005dd80 2026-02-25T15:00:36.086 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc2e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8b44cddc-ab46-44b5-9e53-ff0aa8d1b538", "id": 4}] 2026-02-25T15:00:36.086 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc2e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:36.086 INFO:teuthology.orchestra.run.trial072.stdout:4 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 10 librados: watch_flush enter 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 10 librados: watch_flush exit 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 20 client.4146.objecter shutdown clearing up homeless session... 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 10 client.4146.objecter successfully canceled tick 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 10 monclient: shutdown 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 >> v1:10.20.193.21:6789/0 conn(0x7fdc4005dd80 legacy=0x7fdc40161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 shutdown_connections 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 >> 10.20.193.72:0/2954435799 conn(0x7fdc400588d0 msgr2=0x7fdc4005b920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.088 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.084+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 shutdown_connections 2026-02-25T15:00:36.089 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.085+0000 7fdc47f44640 1 -- 10.20.193.72:0/2954435799 wait complete. 2026-02-25T15:00:36.089 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.085+0000 7fdc47f44640 1 librados: shutdown 2026-02-25T15:00:36.096 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new c6adb78c-cb03-44a0-a9bd-aee84a864607 5 2026-02-25T15:00:36.163 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.160+0000 7fa67dc2b640 10 monclient: get_monmap_and_config 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.160+0000 7fa67dc2b640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.160+0000 7fa67dc2b640 10 monclient: monmap: 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:36.161350+0000 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:36.161350+0000 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.164 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 1 Processor -- start 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 1 -- start start 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient: init 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7fa67805d9b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7fa67805dd80 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7fa6781649b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67805e200 con 0x7fa6781649b0 2026-02-25T15:00:36.165 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6781874c0 con 0x7fa67805d9b0 2026-02-25T15:00:36.166 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6781886a0 con 0x7fa67805dd80 2026-02-25T15:00:36.166 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.166 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa67dc2b640 10 monclient(hunting): authenticate will time out at 2981.895308s 2026-02-25T15:00:36.166 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa6777fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fa67805d9b0 0x7fa67811b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55148/0 (socket says 10.20.193.72:55148) 2026-02-25T15:00:36.166 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.161+0000 7fa6777fe640 1 -- 10.20.193.72:0/940020178 learned_addr learned my addr 10.20.193.72:0/940020178 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.172 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737068174 0 0) 0x7fa6781886a0 con 0x7fa67805dd80 2026-02-25T15:00:36.173 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.173 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.173 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.173 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 10 monclient(hunting): my global_id is 4163 2026-02-25T15:00:36.173 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.171+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa65c003610 con 0x7fa67805dd80 2026-02-25T15:00:36.177 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3564658269 0 0) 0x7fa65c003610 con 0x7fa67805dd80 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 >> v1:10.20.193.31:6789/0 conn(0x7fa67805d9b0 legacy=0x7fa67811b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 >> v1:10.20.193.21:6789/0 conn(0x7fa6781649b0 legacy=0x7fa678184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 monclient: found mon.noname-c 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa678189920 con 0x7fa67805dd80 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.178 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa668002df0 con 0x7fa67805dd80 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.172+0000 7fa6767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: dump: 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.179 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa67dc2b640 5 monclient: authenticate success, global_id 4163 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa67dc2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa668003070 con 0x7fa67805dd80 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 1 -- 10.20.193.72:0/940020178 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa6680034b0 con 0x7fa67805dd80 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa67dc2b640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa67dc2b640 4 set_mon_vals no callback set 2026-02-25T15:00:36.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.173+0000 7fa6767fc640 10 monclient: dump: 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.181 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: shutdown 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- 10.20.193.72:0/940020178 >> v1:10.20.193.68:6789/0 conn(0x7fa67805dd80 legacy=0x7fa67811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- 10.20.193.72:0/940020178 shutdown_connections 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- 10.20.193.72:0/940020178 >> 10.20.193.72:0/940020178 conn(0x7fa6780588d0 msgr2=0x7fa678058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- 10.20.193.72:0/940020178 shutdown_connections 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- 10.20.193.72:0/940020178 wait complete. 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: monmap: 2026-02-25T15:00:36.182 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 librados: starting msgr at 2026-02-25T15:00:36.183 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 librados: starting objecter 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 Processor -- start 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- start start 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 librados: setting wanted keys 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 librados: calling monclient init 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: init 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7fa67805d9b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7fa67805dd80 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7fa6781649b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa678102360 con 0x7fa6781649b0 2026-02-25T15:00:36.184 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa678109240 con 0x7fa67805d9b0 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67810a420 con 0x7fa67805dd80 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.174+0000 7fa67dc2b640 10 monclient(hunting): authenticate will time out at 2981.908705s 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.175+0000 7fa676ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa67805dd80 0x7fa678161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:58322/0 (socket says 10.20.193.72:58322) 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.175+0000 7fa676ffd640 1 -- 10.20.193.72:0/4104848996 learned_addr learned my addr 10.20.193.72:0/4104848996 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.175+0000 7fa653fff640 10 client.?.objecter ms_handle_connect 0x7fa67805dd80 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.175+0000 7fa653fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561404514 0 0) 0x7fa67810a420 con 0x7fa67805dd80 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.185 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 10 monclient(hunting): my global_id is 4166 2026-02-25T15:00:36.186 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.176+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa648003610 con 0x7fa67805dd80 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 861184713 0 0) 0x7fa648003610 con 0x7fa67805dd80 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa67810a420 con 0x7fa67805dd80 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa668002d40 con 0x7fa67805dd80 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:36.188 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 10 monclient(hunting): dump: 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.178+0000 7fa653fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:36.189 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 542218725 0 0) 0x7fa67810a420 con 0x7fa67805dd80 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 >> v1:10.20.193.31:6789/0 conn(0x7fa67805d9b0 legacy=0x7fa678101850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 >> v1:10.20.193.21:6789/0 conn(0x7fa6781649b0 legacy=0x7fa6781630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 1 monclient: found mon.c 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67810b600 con 0x7fa67805dd80 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.190 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa653fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 5 monclient: authenticate success, global_id 4166 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _renew_subs 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa678109410 con 0x7fa67805dd80 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 client.4166.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _renew_subs 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa678109a50 con 0x7fa67805dd80 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 1 librados: init done 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.191 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.192 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.180+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa678187bc0 con 0x7fa67805dd80 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa668002f50 con 0x7fa67805dd80 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa668003c30 con 0x7fa67805dd80 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa653fff640 10 monclient: dump: 2026-02-25T15:00:36.213 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.214 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.215 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.211+0000 7fa675ffb640 4 set_mon_vals no callback set 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.212+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 2716666185 0 0) 0x7fa668003e10 con 0x7fa67805dd80 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 3203857183 0 0) 0x7fa668004310 con 0x7fa67805dd80 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 10 client.4166.objecter ms_dispatch2 0x7fa678000b90 osd_map(7..7 src has 1..7) 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 3 client.4166.objecter handle_osd_map got epochs [7,7] > 0 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 3 client.4166.objecter handle_osd_map decoding full epoch 7 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 20 client.4166.objecter dump_active .. 0 homeless 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fa668017b90 con 0x7fa67805dd80 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.216 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.214+0000 7fa653fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:36.250 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.248+0000 7fa67dc2b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c6adb78c-cb03-44a0-a9bd-aee84a864607", "id": 5}] 2026-02-25T15:00:36.250 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.248+0000 7fa67dc2b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c6adb78c-cb03-44a0-a9bd-aee84a864607", "id": 5}] 2026-02-25T15:00:36.250 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.248+0000 7fa67dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.250 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.248+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "c6adb78c-cb03-44a0-a9bd-aee84a864607", "id": 5} v 0) -- 0x7fa678109d90 con 0x7fa67805dd80 2026-02-25T15:00:36.265 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa653fff640 1 -- 10.20.193.72:0/4104848996 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6adb78c-cb03-44a0-a9bd-aee84a864607", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3953328573 0 1988412176) 0x7fa668017490 con 0x7fa67805dd80 2026-02-25T15:00:36.266 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa653fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c6adb78c-cb03-44a0-a9bd-aee84a864607", "id": 5}] 2026-02-25T15:00:36.266 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa653fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:36.266 INFO:teuthology.orchestra.run.trial072.stdout:5 2026-02-25T15:00:36.267 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 10 librados: watch_flush enter 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 10 librados: watch_flush exit 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 20 client.4166.objecter shutdown clearing up homeless session... 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 10 client.4166.objecter successfully canceled tick 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 10 monclient: shutdown 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 >> v1:10.20.193.68:6789/0 conn(0x7fa67805dd80 legacy=0x7fa678161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 shutdown_connections 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 >> 10.20.193.72:0/4104848996 conn(0x7fa6780588d0 msgr2=0x7fa67805b940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 shutdown_connections 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 -- 10.20.193.72:0/4104848996 wait complete. 2026-02-25T15:00:36.268 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.264+0000 7fa67dc2b640 1 librados: shutdown 2026-02-25T15:00:36.274 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 2bb10359-a68d-4143-824c-54a8fb10f9a1 6 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: get_monmap_and_config 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: monmap: 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:36.335902+0000 2026-02-25T15:00:36.338 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:36.335902+0000 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 1 Processor -- start 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 1 -- start start 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: init 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.339 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-b con 0x7fe91011c500 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-a con 0x7fe91011e420 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-c con 0x7fe91011ffc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe910120d10 con 0x7fe91011e420 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe910120f00 con 0x7fe91011c500 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9101210f0 con 0x7fe91011ffc0 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.335+0000 7fe917f6f640 10 monclient(hunting): authenticate will time out at 2982.069820s 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.336+0000 7fe915ce4640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe91011c500 0x7fe91011c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55158/0 (socket says 10.20.193.72:55158) 2026-02-25T15:00:36.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.336+0000 7fe915ce4640 1 -- 10.20.193.72:0/361768660 learned_addr learned my addr 10.20.193.72:0/361768660 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813017124 0 0) 0x7fe910120f00 con 0x7fe91011c500 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 10 monclient(hunting): my global_id is 4162 2026-02-25T15:00:36.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.355+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f8003610 con 0x7fe91011c500 2026-02-25T15:00:36.358 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 557488004 0 0) 0x7fe8f8003610 con 0x7fe91011c500 2026-02-25T15:00:36.358 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 >> v1:10.20.193.68:6789/0 conn(0x7fe91011ffc0 legacy=0x7fe910120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 >> v1:10.20.193.21:6789/0 conn(0x7fe91011e420 legacy=0x7fe91011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 monclient: found mon.noname-b 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910121380 con 0x7fe91011c500 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe900002df0 con 0x7fe91011c500 2026-02-25T15:00:36.359 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: dump: 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.360 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.361 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe917f6f640 5 monclient: authenticate success, global_id 4162 2026-02-25T15:00:36.361 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe917f6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:36.367 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe900003070 con 0x7fe91011c500 2026-02-25T15:00:36.367 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.367 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 1 -- 10.20.193.72:0/361768660 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9000034b0 con 0x7fe91011c500 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe914ce2640 10 monclient: dump: 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.368 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe917f6f640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.357+0000 7fe917f6f640 4 set_mon_vals no callback set 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 10 monclient: shutdown 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- 10.20.193.72:0/361768660 >> v1:10.20.193.31:6789/0 conn(0x7fe91011c500 legacy=0x7fe91011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- 10.20.193.72:0/361768660 shutdown_connections 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- 10.20.193.72:0/361768660 >> 10.20.193.72:0/361768660 conn(0x7fe9100588d0 msgr2=0x7fe910058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- 10.20.193.72:0/361768660 shutdown_connections 2026-02-25T15:00:36.369 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- 10.20.193.72:0/361768660 wait complete. 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 10 monclient: monmap: 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.370 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 librados: starting msgr at 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 librados: starting objecter 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 Processor -- start 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 -- start start 2026-02-25T15:00:36.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 librados: setting wanted keys 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 1 librados: calling monclient init 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 10 monclient: init 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.358+0000 7fe917f6f640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-c con 0x7fe91011c500 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-a con 0x7fe91011e420 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient(hunting): picked mon.noname-b con 0x7fe91011ffc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe910179670 con 0x7fe91011e420 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91017a850 con 0x7fe91011ffc0 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91017ba30 con 0x7fe91011c500 2026-02-25T15:00:36.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe917f6f640 10 monclient(hunting): authenticate will time out at 2982.093047s 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe9164e5640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe91011ffc0 0x7fe910177f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55166/0 (socket says 10.20.193.72:55166) 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe9164e5640 1 -- 10.20.193.72:0/2408056778 learned_addr learned my addr 10.20.193.72:0/2408056778 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe8fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe91011ffc0 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.359+0000 7fe8fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe91011e420 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.373 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904585378 0 0) 0x7fe91017a850 con 0x7fe91011ffc0 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 10 monclient(hunting): my global_id is 4165 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.360+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e0003610 con 0x7fe91011ffc0 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050363762 0 0) 0x7fe910179670 con 0x7fe91011e420 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.374 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 monclient(hunting): my global_id is 4149 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe91017a850 con 0x7fe91011e420 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4054579822 0 0) 0x7fe8e0003610 con 0x7fe91011ffc0 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe910179670 con 0x7fe91011ffc0 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe91011c500 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.362+0000 7fe8fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe90c0035f0 con 0x7fe91011ffc0 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): dump: 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.375 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860612026 0 0) 0x7fe91017ba30 con 0x7fe91011c500 2026-02-25T15:00:36.376 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 10 monclient(hunting): my global_id is 4172 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.363+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e0003610 con 0x7fe91011c500 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3085191312 0 0) 0x7fe910179670 con 0x7fe91011ffc0 2026-02-25T15:00:36.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 >> v1:10.20.193.68:6789/0 conn(0x7fe91011c500 legacy=0x7fe91012fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 >> v1:10.20.193.21:6789/0 conn(0x7fe91011e420 legacy=0x7fe910176830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 1 monclient: found mon.b 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91017cc10 con 0x7fe91011ffc0 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe8fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 5 monclient: authenticate success, global_id 4165 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _renew_subs 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe910179840 con 0x7fe91011ffc0 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 client.4165.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _renew_subs 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe910179e80 con 0x7fe91011ffc0 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 1 librados: init done 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.380 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.364+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91018b5c0 con 0x7fe91011ffc0 2026-02-25T15:00:36.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe90c003800 con 0x7fe91011ffc0 2026-02-25T15:00:36.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe90c003ed0 con 0x7fe91011ffc0 2026-02-25T15:00:36.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 10 monclient: dump: 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.398 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fffff640 4 set_mon_vals no callback set 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.395+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 2716666185 0 0) 0x7fe90c0040b0 con 0x7fe91011ffc0 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.396+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 1849748197 0 0) 0x7fe90c021770 con 0x7fe91011ffc0 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.396+0000 7fe8fe7fc640 10 client.4165.objecter ms_dispatch2 0x7fe910000b90 osd_map(8..8 src has 1..8) 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.396+0000 7fe8fe7fc640 3 client.4165.objecter handle_osd_map got epochs [8,8] > 0 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.396+0000 7fe8fe7fc640 3 client.4165.objecter handle_osd_map decoding full epoch 8 2026-02-25T15:00:36.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.396+0000 7fe8fe7fc640 20 client.4165.objecter dump_active .. 0 homeless 2026-02-25T15:00:36.460 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.459+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fe90c017de0 con 0x7fe91011ffc0 2026-02-25T15:00:36.460 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.459+0000 7fe8fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.460 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.459+0000 7fe8fe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:36.494 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.492+0000 7fe917f6f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "2bb10359-a68d-4143-824c-54a8fb10f9a1", "id": 6}] 2026-02-25T15:00:36.494 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.492+0000 7fe917f6f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "2bb10359-a68d-4143-824c-54a8fb10f9a1", "id": 6}] 2026-02-25T15:00:36.494 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.492+0000 7fe917f6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.494 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.492+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2bb10359-a68d-4143-824c-54a8fb10f9a1", "id": 6} v 0) -- 0x7fe91017a210 con 0x7fe91011ffc0 2026-02-25T15:00:36.558 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.556+0000 7fe8fe7fc640 1 -- 10.20.193.72:0/2408056778 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2bb10359-a68d-4143-824c-54a8fb10f9a1", "id": 6}]=0 v9) ==== 112+0+2 (unknown 3015088258 0 1113811849) 0x7fe91017a210 con 0x7fe91011ffc0 2026-02-25T15:00:36.558 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.556+0000 7fe8fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "2bb10359-a68d-4143-824c-54a8fb10f9a1", "id": 6}] 2026-02-25T15:00:36.558 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.556+0000 7fe8fe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:36.559 INFO:teuthology.orchestra.run.trial072.stdout:6 2026-02-25T15:00:36.560 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 10 librados: watch_flush enter 2026-02-25T15:00:36.560 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 10 librados: watch_flush exit 2026-02-25T15:00:36.560 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 20 client.4165.objecter shutdown clearing up homeless session... 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 10 client.4165.objecter successfully canceled tick 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 10 monclient: shutdown 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 >> v1:10.20.193.31:6789/0 conn(0x7fe91011ffc0 legacy=0x7fe910177f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 shutdown_connections 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 >> 10.20.193.72:0/2408056778 conn(0x7fe9100588d0 msgr2=0x7fe910058e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 shutdown_connections 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 -- 10.20.193.72:0/2408056778 wait complete. 2026-02-25T15:00:36.561 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.557+0000 7fe917f6f640 1 librados: shutdown 2026-02-25T15:00:36.565 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 1f2b553f-d0bf-4ea0-ae80-cafc4db45470 7 2026-02-25T15:00:36.640 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: get_monmap_and_config 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: monmap: 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:36.638682+0000 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:36.638682+0000 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.641 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 1 Processor -- start 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 1 -- start start 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: init 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-c con 0x7f5de811e790 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-a con 0x7f5de81406c0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.642 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-b con 0x7f5de8162250 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de8183fe0 con 0x7f5de81406c0 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de81851e0 con 0x7f5de8162250 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de81863e0 con 0x7f5de811e790 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.638+0000 7f5deee24640 10 monclient(hunting): authenticate will time out at 2982.372612s 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.639+0000 7f5decb99640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f5de811e790 0x7f5de811eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:58344/0 (socket says 10.20.193.72:58344) 2026-02-25T15:00:36.643 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.639+0000 7f5decb99640 1 -- 10.20.193.72:0/521504426 learned_addr learned my addr 10.20.193.72:0/521504426 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2261949959 0 0) 0x7f5de81863e0 con 0x7f5de811e790 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): my global_id is 4175 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd4003610 con 0x7f5de811e790 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206234678 0 0) 0x7f5de8183fe0 con 0x7f5de81406c0 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.650 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): my global_id is 4152 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de81863e0 con 0x7f5de81406c0 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427347883 0 0) 0x7f5de81851e0 con 0x7f5de8162250 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 10 monclient(hunting): my global_id is 4168 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.640+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de8183fe0 con 0x7f5de8162250 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2028821519 0 0) 0x7f5de81863e0 con 0x7f5de81406c0 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 >> v1:10.20.193.68:6789/0 conn(0x7f5de811e790 legacy=0x7f5de811eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 >> v1:10.20.193.31:6789/0 conn(0x7f5de8162250 legacy=0x7f5de81826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.651 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 monclient: found mon.noname-a 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de8187680 con 0x7f5de81406c0 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5dd0002df0 con 0x7f5de81406c0 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5ddf7fe640 10 monclient: dump: 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.652 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5deee24640 5 monclient: authenticate success, global_id 4152 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.642+0000 7f5deee24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dd0003030 con 0x7f5de81406c0 2026-02-25T15:00:36.653 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 1 -- 10.20.193.72:0/521504426 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5dd0003470 con 0x7f5de81406c0 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5ddf7fe640 10 monclient: dump: 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.654 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 4 set_mon_vals no callback set 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: shutdown 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- 10.20.193.72:0/521504426 >> v1:10.20.193.21:6789/0 conn(0x7f5de81406c0 legacy=0x7f5de8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- 10.20.193.72:0/521504426 shutdown_connections 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- 10.20.193.72:0/521504426 >> 10.20.193.72:0/521504426 conn(0x7f5de80588d0 msgr2=0x7f5de8058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- 10.20.193.72:0/521504426 shutdown_connections 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- 10.20.193.72:0/521504426 wait complete. 2026-02-25T15:00:36.655 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: monmap: 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 librados: starting msgr at 2026-02-25T15:00:36.656 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 librados: starting objecter 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 Processor -- start 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 -- start start 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 librados: setting wanted keys 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 1 librados: calling monclient init 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: init 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-a con 0x7f5de811e790 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.643+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-c con 0x7f5de81406c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 10 monclient(hunting): picked mon.noname-b con 0x7f5de8162250 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.657 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de8104750 con 0x7f5de811e790 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de810c5b0 con 0x7f5de8162250 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5de810d7d0 con 0x7f5de81406c0 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5deee24640 10 monclient(hunting): authenticate will time out at 2982.378031s 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5decb99640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5de811e790 0x7f5de81826e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51336/0 (socket says 10.20.193.72:51336) 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5decb99640 1 -- 10.20.193.72:0/2744081757 learned_addr learned my addr 10.20.193.72:0/2744081757 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter ms_handle_connect 0x7f5de81406c0 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter ms_handle_connect 0x7f5de8162250 2026-02-25T15:00:36.658 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter ms_handle_connect 0x7f5de811e790 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.644+0000 7f5ddd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156594621 0 0) 0x7f5de810d7d0 con 0x7f5de81406c0 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): my global_id is 4178 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db8003610 con 0x7f5de81406c0 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757924990 0 0) 0x7f5de810c5b0 con 0x7f5de8162250 2026-02-25T15:00:36.659 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): my global_id is 4171 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de810d7d0 con 0x7f5de8162250 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511544599 0 0) 0x7f5de8104750 con 0x7f5de811e790 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 10 monclient(hunting): my global_id is 4155 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.645+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de810c5b0 con 0x7f5de811e790 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1268990345 0 0) 0x7f5db8003610 con 0x7f5de81406c0 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5de8104750 con 0x7f5de81406c0 2026-02-25T15:00:36.660 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5dd0003380 con 0x7f5de81406c0 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.661 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 986619385 0 0) 0x7f5de810d7d0 con 0x7f5de8162250 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5db8003610 con 0x7f5de8162250 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5de4003410 con 0x7f5de8162250 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.647+0000 7f5ddd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.662 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4262128862 0 0) 0x7f5de810c5b0 con 0x7f5de811e790 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5de810d7d0 con 0x7f5de811e790 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5dd80030b0 con 0x7f5de811e790 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.648+0000 7f5ddd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:36.663 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.664 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1331559097 0 0) 0x7f5de8104750 con 0x7f5de81406c0 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 >> v1:10.20.193.31:6789/0 conn(0x7f5de8162250 legacy=0x7f5de8161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 >> v1:10.20.193.21:6789/0 conn(0x7f5de811e790 legacy=0x7f5de81826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 1 monclient: found mon.c 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.667 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de810ea70 con 0x7f5de81406c0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5ddd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 5 monclient: authenticate success, global_id 4178 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _renew_subs 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5de810c7e0 con 0x7f5de81406c0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 client.4178.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _renew_subs 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5de810cd80 con 0x7f5de81406c0 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 1 librados: init done 2026-02-25T15:00:36.668 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.649+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de8186ab0 con 0x7f5de81406c0 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dd0002fb0 con 0x7f5de81406c0 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5dd0003bf0 con 0x7f5de81406c0 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddeffd640 4 set_mon_vals no callback set 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.653+0000 7f5ddd7fa640 10 monclient: dump: 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.669 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.654+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 2716666185 0 0) 0x7f5dd00107b0 con 0x7f5de81406c0 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.655+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 27110170 0 0) 0x7f5dd00157e0 con 0x7f5de81406c0 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.655+0000 7f5ddd7fa640 10 client.4178.objecter ms_dispatch2 0x7f5de8000b90 osd_map(9..9 src has 1..9) 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.655+0000 7f5ddd7fa640 3 client.4178.objecter handle_osd_map got epochs [9,9] > 0 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.655+0000 7f5ddd7fa640 3 client.4178.objecter handle_osd_map decoding full epoch 9 2026-02-25T15:00:36.670 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.655+0000 7f5ddd7fa640 20 client.4178.objecter dump_active .. 0 homeless 2026-02-25T15:00:36.698 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.697+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f5dd00165c0 con 0x7f5de81406c0 2026-02-25T15:00:36.698 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.697+0000 7f5ddd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.698 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.697+0000 7f5ddd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:36.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.729+0000 7f5deee24640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1f2b553f-d0bf-4ea0-ae80-cafc4db45470", "id": 7}] 2026-02-25T15:00:36.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.729+0000 7f5deee24640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1f2b553f-d0bf-4ea0-ae80-cafc4db45470", "id": 7}] 2026-02-25T15:00:36.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.729+0000 7f5deee24640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:36.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.729+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "1f2b553f-d0bf-4ea0-ae80-cafc4db45470", "id": 7} v 0) -- 0x7f5de810d0c0 con 0x7f5de81406c0 2026-02-25T15:00:36.810 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.809+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7f5dd0016120 con 0x7f5de81406c0 2026-02-25T15:00:36.811 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.809+0000 7f5decb99640 10 monclient: get_auth_request con 0x7f5db807a340 auth_method 0 2026-02-25T15:00:36.811 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.809+0000 7f5ddd7fa640 10 client.4178.objecter ms_handle_connect 0x7f5db807a340 2026-02-25T15:00:36.855 INFO:tasks.ceph.mgr.x.trial072.stderr:2026-02-25T15:00:36.853+0000 7fc5985ec640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-25T15:00:36.885 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.883+0000 7f5ddd7fa640 1 -- 10.20.193.72:0/2744081757 <== mon.2 v1:10.20.193.68:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1f2b553f-d0bf-4ea0-ae80-cafc4db45470", "id": 7}]=0 v10) ==== 112+0+2 (unknown 1562861090 0 1371665406) 0x7f5dd0003520 con 0x7f5de81406c0 2026-02-25T15:00:36.885 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.883+0000 7f5ddd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1f2b553f-d0bf-4ea0-ae80-cafc4db45470", "id": 7}] 2026-02-25T15:00:36.885 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.883+0000 7f5ddd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:36.885 INFO:teuthology.orchestra.run.trial072.stdout:7 2026-02-25T15:00:36.887 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 10 librados: watch_flush enter 2026-02-25T15:00:36.887 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 10 librados: watch_flush exit 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 20 client.4178.objecter shutdown clearing up homeless session... 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 10 client.4178.objecter successfully canceled tick 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 >> v1:10.20.193.72:6800/2463505645 conn(0x7f5db807a340 legacy=0x7f5db809a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 10 monclient: shutdown 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.888 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 >> v1:10.20.193.68:6789/0 conn(0x7f5de81406c0 legacy=0x7f5de8103d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.889 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 shutdown_connections 2026-02-25T15:00:36.889 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 >> 10.20.193.72:0/2744081757 conn(0x7f5de80588d0 msgr2=0x7f5de8183350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.889 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 shutdown_connections 2026-02-25T15:00:36.889 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 -- 10.20.193.72:0/2744081757 wait complete. 2026-02-25T15:00:36.889 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.884+0000 7f5deee24640 1 librados: shutdown 2026-02-25T15:00:36.893 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new cc24764d-37ea-492f-9a2b-cc82dc42d5f2 8 2026-02-25T15:00:36.901 INFO:tasks.ceph.mgr.x.trial072.stderr:2026-02-25T15:00:36.900+0000 7fc5985ec640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-25T15:00:36.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: get_monmap_and_config 2026-02-25T15:00:36.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.961 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: monmap: 2026-02-25T15:00:36.961 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.961 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:36.959040+0000 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:36.959040+0000 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 1 Processor -- start 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 1 -- start start 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: init 2026-02-25T15:00:36.962 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-a con 0x7fec0405d9b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-b con 0x7fec0405dd80 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-c con 0x7fec041649b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0405e200 con 0x7fec0405d9b0 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec041874c0 con 0x7fec0405dd80 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec041886a0 con 0x7fec041649b0 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.958+0000 7fec0bd3a640 10 monclient(hunting): authenticate will time out at 2982.692983s 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.959+0000 7fec092ae640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fec0405dd80 0x7fec0411b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:55206/0 (socket says 10.20.193.72:55206) 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.959+0000 7fec092ae640 1 -- 10.20.193.72:0/2957032147 learned_addr learned my addr 10.20.193.72:0/2957032147 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.963 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.959+0000 7fec0a2b0640 1 --1- 10.20.193.72:0/2957032147 >> v1:10.20.193.68:6789/0 conn(0x7fec041649b0 0x7fec04184d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:58372/0 (socket says 10.20.193.72:58372) 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559570197 0 0) 0x7fec041874c0 con 0x7fec0405dd80 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): my global_id is 4174 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febec003610 con 0x7fec0405dd80 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880137484 0 0) 0x7fec041886a0 con 0x7fec041649b0 2026-02-25T15:00:36.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): my global_id is 4181 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec041874c0 con 0x7fec041649b0 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456803492 0 0) 0x7fec0405e200 con 0x7fec0405d9b0 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 10 monclient(hunting): my global_id is 4158 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.960+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec041886a0 con 0x7fec0405d9b0 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2897187794 0 0) 0x7febec003610 con 0x7fec0405dd80 2026-02-25T15:00:36.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 >> v1:10.20.193.68:6789/0 conn(0x7fec041649b0 legacy=0x7fec04184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 >> v1:10.20.193.21:6789/0 conn(0x7fec0405d9b0 legacy=0x7fec0411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 monclient: found mon.noname-b 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec04189920 con 0x7fec0405dd80 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7febf8002df0 con 0x7fec0405dd80 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.974 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec08aad640 10 monclient: dump: 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.975 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec0bd3a640 5 monclient: authenticate success, global_id 4174 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.962+0000 7fec0bd3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febf8003030 con 0x7fec0405dd80 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 1 -- 10.20.193.72:0/2957032147 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7febf8003470 con 0x7fec0405dd80 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec08aad640 10 monclient: dump: 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.976 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 4 set_mon_vals no callback set 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: shutdown 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- 10.20.193.72:0/2957032147 >> v1:10.20.193.31:6789/0 conn(0x7fec0405dd80 legacy=0x7fec0411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- 10.20.193.72:0/2957032147 shutdown_connections 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- 10.20.193.72:0/2957032147 >> 10.20.193.72:0/2957032147 conn(0x7fec040588d0 msgr2=0x7fec04058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:36.977 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- 10.20.193.72:0/2957032147 shutdown_connections 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- 10.20.193.72:0/2957032147 wait complete. 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: build_initial_monmap 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: monmap: 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:36.978 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 librados: starting msgr at 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 librados: starting objecter 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 Processor -- start 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- start start 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 librados: setting wanted keys 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 librados: calling monclient init 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: init 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-a con 0x7fec0405d9b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:36.979 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-b con 0x7fec0405dd80 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient(hunting): picked mon.noname-c con 0x7fec041649b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec04102350 con 0x7fec0405d9b0 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec04109230 con 0x7fec0405dd80 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0410a410 con 0x7fec041649b0 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.963+0000 7fec0bd3a640 10 monclient(hunting): authenticate will time out at 2982.697940s 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7fec09aaf640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fec0405d9b0 0x7fec04101840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:51344/0 (socket says 10.20.193.72:51344) 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7fec09aaf640 1 -- 10.20.193.72:0/1329190667 learned_addr learned my addr 10.20.193.72:0/1329190667 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter ms_handle_connect 0x7fec0405dd80 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter ms_handle_connect 0x7fec0405d9b0 2026-02-25T15:00:36.980 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter ms_handle_connect 0x7fec041649b0 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.964+0000 7febf27fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250390493 0 0) 0x7fec04109230 con 0x7fec0405dd80 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): my global_id is 4177 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febd4003610 con 0x7fec0405dd80 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188814023 0 0) 0x7fec04102350 con 0x7fec0405d9b0 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.981 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): my global_id is 4161 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec04109230 con 0x7fec0405d9b0 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902009718 0 0) 0x7fec0410a410 con 0x7fec041649b0 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 10 monclient(hunting): my global_id is 4184 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.965+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec04102350 con 0x7fec041649b0 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2688379370 0 0) 0x7febd4003610 con 0x7fec0405dd80 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec0410a410 con 0x7fec0405dd80 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7febf80031e0 con 0x7fec0405dd80 2026-02-25T15:00:36.982 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): dump: 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.983 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2850495717 0 0) 0x7fec04109230 con 0x7fec0405d9b0 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7febd4003610 con 0x7fec0405d9b0 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7febf4003170 con 0x7fec0405d9b0 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.967+0000 7febf27fc640 10 monclient(hunting): dump: 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.984 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 477335887 0 0) 0x7fec04102350 con 0x7fec041649b0 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec04109230 con 0x7fec041649b0 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fec00003400 con 0x7fec041649b0 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.968+0000 7febf27fc640 10 monclient(hunting): dump: 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.985 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 735416043 0 0) 0x7fec0410a410 con 0x7fec0405dd80 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 >> v1:10.20.193.68:6789/0 conn(0x7fec041649b0 legacy=0x7fec041630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 >> v1:10.20.193.21:6789/0 conn(0x7fec0405d9b0 legacy=0x7fec04101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:36.986 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 1 monclient: found mon.b 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0410b5f0 con 0x7fec0405dd80 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7febf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 5 monclient: authenticate success, global_id 4177 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _renew_subs 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec04108220 con 0x7fec0405dd80 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 client.4177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:36.987 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _renew_subs 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec04108790 con 0x7fec0405dd80 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 1 librados: init done 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:36.988 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.969+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec04188d70 con 0x7fec0405dd80 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7febf8002fb0 con 0x7fec0405dd80 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7febf8004ce0 con 0x7fec0405dd80 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf27fc640 10 monclient: dump: 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:36.990 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.976+0000 7febf3fff640 4 set_mon_vals no callback set 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.977+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7febf801e120 con 0x7fec0405dd80 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.977+0000 7fec09aaf640 10 monclient: get_auth_request con 0x7febd4079f40 auth_method 0 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 10 client.4177.objecter ms_handle_connect 0x7febd4079f40 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 2738142276 0 0) 0x7febf805aa90 con 0x7fec0405dd80 2026-02-25T15:00:36.991 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 10 client.4177.objecter ms_dispatch2 0x7fec04000b90 osd_map(10..10 src has 1..10) 2026-02-25T15:00:36.992 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 3 client.4177.objecter handle_osd_map got epochs [10,10] > 0 2026-02-25T15:00:36.992 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 3 client.4177.objecter handle_osd_map decoding full epoch 10 2026-02-25T15:00:36.992 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:36.978+0000 7febf27fc640 20 client.4177.objecter dump_active .. 0 homeless 2026-02-25T15:00:37.068 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.067+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7febf805f200 con 0x7fec0405dd80 2026-02-25T15:00:37.068 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.067+0000 7febf27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.068 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.067+0000 7febf27fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:37.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.178+0000 7fec0bd3a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "cc24764d-37ea-492f-9a2b-cc82dc42d5f2", "id": 8}] 2026-02-25T15:00:37.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.178+0000 7fec0bd3a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "cc24764d-37ea-492f-9a2b-cc82dc42d5f2", "id": 8}] 2026-02-25T15:00:37.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.178+0000 7fec0bd3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.180 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.178+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd new", "uuid": "cc24764d-37ea-492f-9a2b-cc82dc42d5f2", "id": 8} v 0) -- 0x7fec04108ad0 con 0x7fec0405dd80 2026-02-25T15:00:37.226 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.224+0000 7febf27fc640 1 -- 10.20.193.72:0/1329190667 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc24764d-37ea-492f-9a2b-cc82dc42d5f2", "id": 8}]=0 v11) ==== 112+0+2 (unknown 479798176 0 3065575683) 0x7febf805eb00 con 0x7fec0405dd80 2026-02-25T15:00:37.226 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.224+0000 7febf27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "cc24764d-37ea-492f-9a2b-cc82dc42d5f2", "id": 8}] 2026-02-25T15:00:37.226 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.224+0000 7febf27fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:37.226 INFO:teuthology.orchestra.run.trial072.stdout:8 2026-02-25T15:00:37.227 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 10 librados: watch_flush enter 2026-02-25T15:00:37.227 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 10 librados: watch_flush exit 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 20 client.4177.objecter shutdown clearing up homeless session... 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 10 client.4177.objecter successfully canceled tick 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 >> v1:10.20.193.72:6800/2463505645 conn(0x7febd4079f40 legacy=0x7febd409a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 10 monclient: shutdown 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 >> v1:10.20.193.31:6789/0 conn(0x7fec0405dd80 legacy=0x7fec04161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 shutdown_connections 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 >> 10.20.193.72:0/1329190667 conn(0x7fec040588d0 msgr2=0x7fec0405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 shutdown_connections 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 -- 10.20.193.72:0/1329190667 wait complete. 2026-02-25T15:00:37.228 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.225+0000 7fec0bd3a640 1 librados: shutdown 2026-02-25T15:00:37.235 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 10009b7b-f7e3-4f8b-b9cb-cff47b583dc6 9 2026-02-25T15:00:37.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: get_monmap_and_config 2026-02-25T15:00:37.340 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: build_initial_monmap 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: monmap: 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:37.339775+0000 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:37.339775+0000 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:37.341 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.343 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 1 Processor -- start 2026-02-25T15:00:37.343 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 1 -- start start 2026-02-25T15:00:37.343 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: init 2026-02-25T15:00:37.343 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:37.343 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient(hunting): picked mon.noname-a con 0x7fe35c11e790 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient(hunting): picked mon.noname-b con 0x7fe35c1406c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient(hunting): picked mon.noname-c con 0x7fe35c162250 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c183fe0 con 0x7fe35c11e790 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c1851e0 con 0x7fe35c1406c0 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c1863e0 con 0x7fe35c162250 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.339+0000 7fe363145640 10 monclient(hunting): authenticate will time out at 2983.073889s 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.340+0000 7fe353fff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe35c1406c0 0x7fe35c160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59626/0 (socket says 10.20.193.72:59626) 2026-02-25T15:00:37.344 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.340+0000 7fe353fff640 1 -- 10.20.193.72:0/2249889017 learned_addr learned my addr 10.20.193.72:0/2249889017 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:37.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452668194 0 0) 0x7fe35c1863e0 con 0x7fe35c162250 2026-02-25T15:00:37.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.370 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 10 monclient(hunting): my global_id is 4187 2026-02-25T15:00:37.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.369+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe348003610 con 0x7fe35c162250 2026-02-25T15:00:37.371 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560471489 0 0) 0x7fe35c1851e0 con 0x7fe35c1406c0 2026-02-25T15:00:37.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 10 monclient(hunting): my global_id is 4180 2026-02-25T15:00:37.372 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.370+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe35c1863e0 con 0x7fe35c1406c0 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3229624859 0 0) 0x7fe348003610 con 0x7fe35c162250 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 >> v1:10.20.193.31:6789/0 conn(0x7fe35c1406c0 legacy=0x7fe35c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 >> v1:10.20.193.21:6789/0 conn(0x7fe35c11e790 legacy=0x7fe35c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 monclient: found mon.noname-c 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c187680 con 0x7fe35c162250 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:37.377 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe358003170 con 0x7fe35c162250 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe3537fe640 10 monclient: dump: 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.378 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe363145640 5 monclient: authenticate success, global_id 4187 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.371+0000 7fe363145640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3580033f0 con 0x7fe35c162250 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 1 -- 10.20.193.72:0/2249889017 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe358003830 con 0x7fe35c162250 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe3537fe640 10 monclient: dump: 2026-02-25T15:00:37.379 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 4 set_mon_vals no callback set 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 10 monclient: shutdown 2026-02-25T15:00:37.380 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 1 -- 10.20.193.72:0/2249889017 >> v1:10.20.193.68:6789/0 conn(0x7fe35c162250 legacy=0x7fe35c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 1 -- 10.20.193.72:0/2249889017 shutdown_connections 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 1 -- 10.20.193.72:0/2249889017 >> 10.20.193.72:0/2249889017 conn(0x7fe35c0588d0 msgr2=0x7fe35c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 1 -- 10.20.193.72:0/2249889017 shutdown_connections 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 1 -- 10.20.193.72:0/2249889017 wait complete. 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 10 monclient: build_initial_monmap 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.372+0000 7fe363145640 10 monclient: monmap: 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:37.381 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 librados: starting msgr at 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 librados: starting objecter 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 Processor -- start 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 -- start start 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 librados: setting wanted keys 2026-02-25T15:00:37.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 librados: calling monclient init 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient: init 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient(hunting): picked mon.noname-b con 0x7fe35c11e790 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient(hunting): picked mon.noname-c con 0x7fe35c1406c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient(hunting): picked mon.noname-a con 0x7fe35c162250 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c104910 con 0x7fe35c162250 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c10c750 con 0x7fe35c11e790 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35c10d970 con 0x7fe35c1406c0 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe363145640 10 monclient(hunting): authenticate will time out at 2983.107362s 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe353fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fe35c1406c0 0x7fe35c103f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45044/0 (socket says 10.20.193.72:45044) 2026-02-25T15:00:37.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe353fff640 1 -- 10.20.193.72:0/653080566 learned_addr learned my addr 10.20.193.72:0/653080566 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe360eba640 1 --1- 10.20.193.72:0/653080566 >> v1:10.20.193.31:6789/0 conn(0x7fe35c11e790 0x7fe35c1826c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59628/0 (socket says 10.20.193.72:59628) 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe3517fa640 10 client.?.objecter ms_handle_connect 0x7fe35c1406c0 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe3517fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe3517fa640 10 client.?.objecter ms_handle_connect 0x7fe35c11e790 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.373+0000 7fe3517fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306868370 0 0) 0x7fe35c10d970 con 0x7fe35c1406c0 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): my global_id is 4190 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c003610 con 0x7fe35c1406c0 2026-02-25T15:00:37.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678569554 0 0) 0x7fe35c10c750 con 0x7fe35c11e790 2026-02-25T15:00:37.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 10 monclient(hunting): my global_id is 4183 2026-02-25T15:00:37.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.374+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe35c10d970 con 0x7fe35c11e790 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.376+0000 7fe3517fa640 10 client.?.objecter ms_handle_connect 0x7fe35c162250 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.376+0000 7fe3517fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2153187357 0 0) 0x7fe35c10d970 con 0x7fe35c11e790 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe35c10c750 con 0x7fe35c11e790 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe34c003040 con 0x7fe35c11e790 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:37.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): dump: 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:37.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3224391625 0 0) 0x7fe32c003610 con 0x7fe35c1406c0 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe35c10d970 con 0x7fe35c1406c0 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe3440030f0 con 0x7fe35c1406c0 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): dump: 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.390 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116167522 0 0) 0x7fe35c187680 con 0x7fe35c162250 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 10 monclient(hunting): my global_id is 4164 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.377+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe32c003610 con 0x7fe35c162250 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 981793665 0 0) 0x7fe35c10c750 con 0x7fe35c11e790 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 >> v1:10.20.193.68:6789/0 conn(0x7fe35c1406c0 legacy=0x7fe35c103f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.391 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 >> v1:10.20.193.21:6789/0 conn(0x7fe35c162250 legacy=0x7fe35c161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 10 monclient: _finish_hunting 0 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 1 monclient: found mon.b 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35c10ec10 con 0x7fe35c11e790 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 10 monclient: _finish_auth 0 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 10 monclient: _check_auth_tickets 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe3517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 5 monclient: authenticate success, global_id 4183 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _renew_subs 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.392 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe35c10c980 con 0x7fe35c11e790 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 client.4183.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _renew_subs 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe35c10cf70 con 0x7fe35c11e790 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 1 librados: init done 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.379+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35c1846e0 con 0x7fe35c11e790 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe34c003700 con 0x7fe35c11e790 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe34c003ad0 con 0x7fe35c11e790 2026-02-25T15:00:37.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe3517fa640 10 monclient: dump: 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.384+0000 7fe352ffd640 4 set_mon_vals no callback set 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.387+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7fe34c003c70 con 0x7fe35c11e790 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe353fff640 10 monclient: get_auth_request con 0x7fe32c079de0 auth_method 0 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 4070437925 0 0) 0x7fe34c05ad80 con 0x7fe35c11e790 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 10 client.4183.objecter ms_dispatch2 0x7fe35c000b90 osd_map(11..11 src has 1..11) 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 3 client.4183.objecter handle_osd_map got epochs [11,11] > 0 2026-02-25T15:00:37.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 3 client.4183.objecter handle_osd_map decoding full epoch 11 2026-02-25T15:00:37.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 20 client.4183.objecter dump_active .. 0 homeless 2026-02-25T15:00:37.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.388+0000 7fe3517fa640 10 client.4183.objecter ms_handle_connect 0x7fe32c079de0 2026-02-25T15:00:37.475 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.474+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe34c05f4f0 con 0x7fe35c11e790 2026-02-25T15:00:37.475 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.474+0000 7fe3517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.475 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.474+0000 7fe3517fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:37.588 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.587+0000 7fe363145640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "10009b7b-f7e3-4f8b-b9cb-cff47b583dc6", "id": 9}] 2026-02-25T15:00:37.588 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.587+0000 7fe363145640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "10009b7b-f7e3-4f8b-b9cb-cff47b583dc6", "id": 9}] 2026-02-25T15:00:37.589 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.587+0000 7fe363145640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:37.589 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.587+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd new", "uuid": "10009b7b-f7e3-4f8b-b9cb-cff47b583dc6", "id": 9} v 0) -- 0x7fe35c10d750 con 0x7fe35c11e790 2026-02-25T15:00:37.636 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.635+0000 7fe3517fa640 1 -- 10.20.193.72:0/653080566 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10009b7b-f7e3-4f8b-b9cb-cff47b583dc6", "id": 9}]=0 v12) ==== 112+0+2 (unknown 2145592422 0 2769969524) 0x7fe35c10d750 con 0x7fe35c11e790 2026-02-25T15:00:37.636 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.635+0000 7fe3517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "10009b7b-f7e3-4f8b-b9cb-cff47b583dc6", "id": 9}] 2026-02-25T15:00:37.636 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.635+0000 7fe3517fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:37.637 INFO:teuthology.orchestra.run.trial072.stdout:9 2026-02-25T15:00:37.638 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 10 librados: watch_flush enter 2026-02-25T15:00:37.638 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 10 librados: watch_flush exit 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 20 client.4183.objecter shutdown clearing up homeless session... 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 10 client.4183.objecter successfully canceled tick 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe32c079de0 legacy=0x7fe32c09a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 10 monclient: shutdown 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 >> v1:10.20.193.31:6789/0 conn(0x7fe35c11e790 legacy=0x7fe35c1826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 shutdown_connections 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 >> 10.20.193.72:0/653080566 conn(0x7fe35c0588d0 msgr2=0x7fe35c058ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 shutdown_connections 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 -- 10.20.193.72:0/653080566 wait complete. 2026-02-25T15:00:37.639 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.636+0000 7fe363145640 1 librados: shutdown 2026-02-25T15:00:37.646 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 1749f993-e477-46c7-8937-5b13265c7666 10 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: get_monmap_and_config 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: build_initial_monmap 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: monmap: 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:37.709075+0000 2026-02-25T15:00:37.711 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:37.709075+0000 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 1 Processor -- start 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 1 -- start start 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: init 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:37.712 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-b con 0x7f05f405d9b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-a con 0x7f05f405dd80 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-c con 0x7f05f41649b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f405e200 con 0x7f05f405dd80 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f41874c0 con 0x7f05f405d9b0 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f41886a0 con 0x7f05f41649b0 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.708+0000 7f05f8ae8640 10 monclient(hunting): authenticate will time out at 2983.442999s 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.709+0000 7f05f2d76640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f05f41649b0 0x7f05f4184d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45048/0 (socket says 10.20.193.72:45048) 2026-02-25T15:00:37.713 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.709+0000 7f05f2d76640 1 -- 10.20.193.72:0/3520140023 learned_addr learned my addr 10.20.193.72:0/3520140023 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:37.721 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948320012 0 0) 0x7f05f41886a0 con 0x7f05f41649b0 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): my global_id is 4193 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e0003610 con 0x7f05f41649b0 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258528230 0 0) 0x7f05f405e200 con 0x7f05f405dd80 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): my global_id is 4167 2026-02-25T15:00:37.722 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f41886a0 con 0x7f05f405dd80 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760450754 0 0) 0x7f05f41874c0 con 0x7f05f405d9b0 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 10 monclient(hunting): my global_id is 4186 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.710+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f405e200 con 0x7f05f405d9b0 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146081986 0 0) 0x7f05e0003610 con 0x7f05f41649b0 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 >> v1:10.20.193.31:6789/0 conn(0x7f05f405d9b0 legacy=0x7f05f411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 >> v1:10.20.193.21:6789/0 conn(0x7f05f405dd80 legacy=0x7f05f411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: _finish_hunting 0 2026-02-25T15:00:37.723 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 monclient: found mon.noname-c 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f4189920 con 0x7f05f41649b0 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: _finish_auth 0 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: _check_auth_tickets 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05e4003170 con 0x7f05f41649b0 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:37.724 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f1573640 10 monclient: dump: 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f8ae8640 5 monclient: authenticate success, global_id 4193 2026-02-25T15:00:37.725 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.712+0000 7f05f8ae8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05e40033b0 con 0x7f05f41649b0 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 1 -- 10.20.193.72:0/3520140023 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05e40037f0 con 0x7f05f41649b0 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f1573640 10 monclient: dump: 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.726 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 4 set_mon_vals no callback set 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 10 monclient: shutdown 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3520140023 >> v1:10.20.193.68:6789/0 conn(0x7f05f41649b0 legacy=0x7f05f4184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3520140023 shutdown_connections 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3520140023 >> 10.20.193.72:0/3520140023 conn(0x7f05f40588d0 msgr2=0x7f05f4058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3520140023 shutdown_connections 2026-02-25T15:00:37.727 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3520140023 wait complete. 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 10 monclient: build_initial_monmap 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 10 monclient: monmap: 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:37.728 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 librados: starting msgr at 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 librados: starting objecter 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 Processor -- start 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 -- start start 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 librados: setting wanted keys 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 1 librados: calling monclient init 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.713+0000 7f05f8ae8640 10 monclient: init 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-b con 0x7f05f405d9b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:37.729 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-c con 0x7f05f405dd80 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient(hunting): picked mon.noname-a con 0x7f05f41649b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f416c7f0 con 0x7f05f41649b0 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f41736d0 con 0x7f05f405d9b0 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f41748b0 con 0x7f05f405dd80 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f8ae8640 10 monclient(hunting): authenticate will time out at 2983.448059s 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f2575640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f05f405d9b0 0x7f05f416bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59646/0 (socket says 10.20.193.72:59646) 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05f2575640 1 -- 10.20.193.72:0/3937291059 learned_addr learned my addr 10.20.193.72:0/3937291059 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter ms_handle_connect 0x7f05f405dd80 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.730 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter ms_handle_connect 0x7f05f41649b0 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter ms_handle_connect 0x7f05f405d9b0 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.714+0000 7f05daffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242910968 0 0) 0x7f05f41748b0 con 0x7f05f405dd80 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): my global_id is 4196 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f405dd80 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318025680 0 0) 0x7f05f416c7f0 con 0x7f05f41649b0 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.731 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): my global_id is 4170 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f41748b0 con 0x7f05f41649b0 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553980579 0 0) 0x7f05f41736d0 con 0x7f05f405d9b0 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 10 monclient(hunting): my global_id is 4189 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.715+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f416c7f0 con 0x7f05f405d9b0 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3011831296 0 0) 0x7f05c0003610 con 0x7f05f405dd80 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f41736d0 con 0x7f05f405dd80 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05dc0030b0 con 0x7f05f405dd80 2026-02-25T15:00:37.732 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 10 monclient(hunting): dump: 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.733 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.717+0000 7f05daffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102067320 0 0) 0x7f05f41748b0 con 0x7f05f41649b0 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f41649b0 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05e4003560 con 0x7f05f41649b0 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): dump: 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.734 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3495823787 0 0) 0x7f05f416c7f0 con 0x7f05f405d9b0 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f41748b0 con 0x7f05f405d9b0 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05e8003170 con 0x7f05f405d9b0 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:37.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.718+0000 7f05daffd640 10 monclient(hunting): dump: 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1233869299 0 0) 0x7f05f41736d0 con 0x7f05f405dd80 2026-02-25T15:00:37.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 >> v1:10.20.193.31:6789/0 conn(0x7f05f405d9b0 legacy=0x7f05f416bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 >> v1:10.20.193.21:6789/0 conn(0x7f05f41649b0 legacy=0x7f05f41630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 10 monclient: _finish_hunting 0 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 1 monclient: found mon.c 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f4175a90 con 0x7f05f405dd80 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 10 monclient: _finish_auth 0 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 10 monclient: _check_auth_tickets 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 5 monclient: authenticate success, global_id 4196 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _renew_subs 2026-02-25T15:00:37.737 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05f41726c0 con 0x7f05f405dd80 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 client.4196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _renew_subs 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05f4172d00 con 0x7f05f405dd80 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 1 librados: init done 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.738 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.719+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f41869b0 con 0x7f05f405dd80 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05dc0036b0 con 0x7f05f405dd80 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05dc003a00 con 0x7f05f405dd80 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05daffd640 10 monclient: dump: 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.740 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.726+0000 7f05f0d72640 4 set_mon_vals no callback set 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.727+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7f05dc01ce40 con 0x7f05f405dd80 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.728+0000 7f05f2575640 10 monclient: get_auth_request con 0x7f05c0079ef0 auth_method 0 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.728+0000 7f05daffd640 10 client.4196.objecter ms_handle_connect 0x7f05c0079ef0 2026-02-25T15:00:37.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.729+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 466637280 0 0) 0x7f05dc0599b0 con 0x7f05f405dd80 2026-02-25T15:00:37.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.729+0000 7f05daffd640 10 client.4196.objecter ms_dispatch2 0x7f05f4000b90 osd_map(12..12 src has 1..12) 2026-02-25T15:00:37.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.729+0000 7f05daffd640 3 client.4196.objecter handle_osd_map got epochs [12,12] > 0 2026-02-25T15:00:37.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.729+0000 7f05daffd640 3 client.4196.objecter handle_osd_map decoding full epoch 12 2026-02-25T15:00:37.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.729+0000 7f05daffd640 20 client.4196.objecter dump_active .. 0 homeless 2026-02-25T15:00:37.818 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.816+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f05dc05e120 con 0x7f05f405dd80 2026-02-25T15:00:37.818 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.816+0000 7f05daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:37.818 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.816+0000 7f05daffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:37.927 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.926+0000 7f05f8ae8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1749f993-e477-46c7-8937-5b13265c7666", "id": 10}] 2026-02-25T15:00:37.928 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.926+0000 7f05f8ae8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1749f993-e477-46c7-8937-5b13265c7666", "id": 10}] 2026-02-25T15:00:37.928 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.926+0000 7f05f8ae8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:37.928 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.926+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "1749f993-e477-46c7-8937-5b13265c7666", "id": 10} v 0) -- 0x7f05f4173040 con 0x7f05f405dd80 2026-02-25T15:00:37.944 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.943+0000 7f05daffd640 1 -- 10.20.193.72:0/3937291059 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1749f993-e477-46c7-8937-5b13265c7666", "id": 10}]=0 v13) ==== 113+0+3 (unknown 298643297 0 520826459) 0x7f05dc05da20 con 0x7f05f405dd80 2026-02-25T15:00:37.944 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.943+0000 7f05daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1749f993-e477-46c7-8937-5b13265c7666", "id": 10}] 2026-02-25T15:00:37.945 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.943+0000 7f05daffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:37.945 INFO:teuthology.orchestra.run.trial072.stdout:10 2026-02-25T15:00:37.946 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 10 librados: watch_flush enter 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 10 librados: watch_flush exit 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 20 client.4196.objecter shutdown clearing up homeless session... 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 10 client.4196.objecter successfully canceled tick 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 >> v1:10.20.193.72:6800/2463505645 conn(0x7f05c0079ef0 legacy=0x7f05c009a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 10 monclient: shutdown 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 >> v1:10.20.193.68:6789/0 conn(0x7f05f405dd80 legacy=0x7f05f4161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 shutdown_connections 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 >> 10.20.193.72:0/3937291059 conn(0x7f05f40588d0 msgr2=0x7f05f405bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 shutdown_connections 2026-02-25T15:00:37.947 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 -- 10.20.193.72:0/3937291059 wait complete. 2026-02-25T15:00:37.948 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:37.944+0000 7f05f8ae8640 1 librados: shutdown 2026-02-25T15:00:37.954 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 7fa229a5-5207-4f26-859a-ea5890b2e939 11 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.018+0000 7fbdc4f83640 10 monclient: get_monmap_and_config 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.018+0000 7fbdc4f83640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.018+0000 7fbdc4f83640 10 monclient: monmap: 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.020 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:38.019548+0000 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:38.019548+0000 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.021 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 1 Processor -- start 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 1 -- start start 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient: init 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-a con 0x7fbdc005da60 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-b con 0x7fbdc005df20 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-c con 0x7fbdc0161240 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.025 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc0182ea0 con 0x7fbdc005da60 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc01840a0 con 0x7fbdc005df20 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc01852a0 con 0x7fbdc0161240 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.019+0000 7fbdc4f83640 10 monclient(hunting): authenticate will time out at 2983.753670s 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.020+0000 7fbdbed76640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbdc0161240 0x7fbdc0181620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45054/0 (socket says 10.20.193.72:45054) 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.020+0000 7fbdbed76640 1 -- 10.20.193.72:0/2125223655 learned_addr learned my addr 10.20.193.72:0/2125223655 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.020+0000 7fbdbe575640 1 --1- 10.20.193.72:0/2125223655 >> v1:10.20.193.21:6789/0 conn(0x7fbdc005da60 0x7fbdc005c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.72:46538/0 (socket says 10.20.193.72:46538) 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703274800 0 0) 0x7fbdc01852a0 con 0x7fbdc0161240 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.026 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): my global_id is 4199 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdac003610 con 0x7fbdc0161240 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585264479 0 0) 0x7fbdc0182ea0 con 0x7fbdc005da60 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): my global_id is 4173 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc01852a0 con 0x7fbdc005da60 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414741616 0 0) 0x7fbdc01840a0 con 0x7fbdc005df20 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.027 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 10 monclient(hunting): my global_id is 4192 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.021+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc0182ea0 con 0x7fbdc005df20 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2085675183 0 0) 0x7fbdac003610 con 0x7fbdc0161240 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 >> v1:10.20.193.31:6789/0 conn(0x7fbdc005df20 legacy=0x7fbdc005caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 >> v1:10.20.193.21:6789/0 conn(0x7fbdc005da60 legacy=0x7fbdc005c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 monclient: found mon.noname-c 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc0186540 con 0x7fbdc0161240 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.028 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbdb0003170 con 0x7fbdc0161240 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdbd573640 10 monclient: dump: 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.029 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdc4f83640 5 monclient: authenticate success, global_id 4199 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.022+0000 7fbdc4f83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbdb0003380 con 0x7fbdc0161240 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 1 -- 10.20.193.72:0/2125223655 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbdb0003780 con 0x7fbdc0161240 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdc4f83640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdc4f83640 4 set_mon_vals no callback set 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.030 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.023+0000 7fbdbd573640 10 monclient: dump: 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.031 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.037 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: shutdown 2026-02-25T15:00:38.037 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2125223655 >> v1:10.20.193.68:6789/0 conn(0x7fbdc0161240 legacy=0x7fbdc0181620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2125223655 shutdown_connections 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2125223655 >> 10.20.193.72:0/2125223655 conn(0x7fbdc00588d0 msgr2=0x7fbdc0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2125223655 shutdown_connections 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2125223655 wait complete. 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: monmap: 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:38.038 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 librados: starting msgr at 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 librados: starting objecter 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 Processor -- start 2026-02-25T15:00:38.039 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- start start 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 librados: setting wanted keys 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 librados: calling monclient init 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: init 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-b con 0x7fbdc005da60 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-a con 0x7fbdc005df20 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient(hunting): picked mon.noname-c con 0x7fbdc0161240 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc014be90 con 0x7fbdc005df20 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc014d070 con 0x7fbdc005da60 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc014e250 con 0x7fbdc0161240 2026-02-25T15:00:38.040 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.024+0000 7fbdc4f83640 10 monclient(hunting): authenticate will time out at 2983.758796s 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbdbed76640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbdc0161240 0x7fbdc014a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45064/0 (socket says 10.20.193.72:45064) 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbdbed76640 1 -- 10.20.193.72:0/2640697597 learned_addr learned my addr 10.20.193.72:0/2640697597 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter ms_handle_connect 0x7fbdc005df20 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter ms_handle_connect 0x7fbdc005da60 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter ms_handle_connect 0x7fbdc0161240 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.025+0000 7fbda6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077328219 0 0) 0x7fbdc014e250 con 0x7fbdc0161240 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.041 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): my global_id is 4202 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8c003610 con 0x7fbdc0161240 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417760447 0 0) 0x7fbdc014d070 con 0x7fbdc005da60 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): my global_id is 4195 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc014e250 con 0x7fbdc005da60 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825054040 0 0) 0x7fbdc014be90 con 0x7fbdc005df20 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.042 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 10 monclient(hunting): my global_id is 4176 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.026+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdc014d070 con 0x7fbdc005df20 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3055769858 0 0) 0x7fbdc014d070 con 0x7fbdc005df20 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdc014be90 con 0x7fbdc005df20 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbda8003060 con 0x7fbdc005df20 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 10 monclient(hunting): dump: 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.043 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.028+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 536905689 0 0) 0x7fbd8c003610 con 0x7fbdc0161240 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbdc014d070 con 0x7fbdc0161240 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbdb0003080 con 0x7fbdc0161240 2026-02-25T15:00:38.044 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): dump: 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.045 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2749204660 0 0) 0x7fbdc014e250 con 0x7fbdc005da60 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd8c003610 con 0x7fbdc005da60 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbdb40031c0 con 0x7fbdc005da60 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.029+0000 7fbda6ffd640 10 monclient(hunting): dump: 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.046 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2990449445 0 0) 0x7fbdc014be90 con 0x7fbdc005df20 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 >> v1:10.20.193.68:6789/0 conn(0x7fbdc0161240 legacy=0x7fbdc014a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 >> v1:10.20.193.31:6789/0 conn(0x7fbdc005da60 legacy=0x7fbdc0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 1 monclient: found mon.a 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:38.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc014f430 con 0x7fbdc005df20 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbda6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 5 monclient: authenticate success, global_id 4176 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _renew_subs 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc014d240 con 0x7fbdc005df20 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 client.4176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _renew_subs 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbdc014d830 con 0x7fbdc005df20 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 1 librados: init done 2026-02-25T15:00:38.048 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.049 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.049 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:38.049 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.030+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc0183590 con 0x7fbdc005df20 2026-02-25T15:00:38.121 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbda8003700 con 0x7fbdc005df20 2026-02-25T15:00:38.121 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.121 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbda8003a50 con 0x7fbdc005df20 2026-02-25T15:00:38.121 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.121 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbda6ffd640 10 monclient: dump: 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.122 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.119+0000 7fbdbcd72640 4 set_mon_vals no callback set 2026-02-25T15:00:38.123 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.120+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7fbda801ce90 con 0x7fbdc005df20 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.121+0000 7fbdbe575640 10 monclient: get_auth_request con 0x7fbd8c079e50 auth_method 0 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.121+0000 7fbda6ffd640 10 client.4176.objecter ms_handle_connect 0x7fbd8c079e50 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.122+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 1074818018 0 0) 0x7fbda8059a30 con 0x7fbdc005df20 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.122+0000 7fbda6ffd640 10 client.4176.objecter ms_dispatch2 0x7fbdc0000b90 osd_map(13..13 src has 1..13) 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.122+0000 7fbda6ffd640 3 client.4176.objecter handle_osd_map got epochs [13,13] > 0 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.122+0000 7fbda6ffd640 3 client.4176.objecter handle_osd_map decoding full epoch 13 2026-02-25T15:00:38.124 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.122+0000 7fbda6ffd640 20 client.4176.objecter dump_active .. 0 homeless 2026-02-25T15:00:38.125 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.124+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fbda805e1a0 con 0x7fbdc005df20 2026-02-25T15:00:38.125 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.124+0000 7fbda6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.125 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.124+0000 7fbda6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:38.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.235+0000 7fbdc4f83640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7fa229a5-5207-4f26-859a-ea5890b2e939", "id": 11}] 2026-02-25T15:00:38.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.235+0000 7fbdc4f83640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7fa229a5-5207-4f26-859a-ea5890b2e939", "id": 11}] 2026-02-25T15:00:38.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.235+0000 7fbdc4f83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:38.237 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.235+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd new", "uuid": "7fa229a5-5207-4f26-859a-ea5890b2e939", "id": 11} v 0) -- 0x7fbdc014db70 con 0x7fbdc005df20 2026-02-25T15:00:38.280 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.279+0000 7fbda6ffd640 1 -- 10.20.193.72:0/2640697597 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7fa229a5-5207-4f26-859a-ea5890b2e939", "id": 11}]=0 v14) ==== 113+0+3 (unknown 2212980144 0 212448812) 0x7fbda805daa0 con 0x7fbdc005df20 2026-02-25T15:00:38.281 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.279+0000 7fbda6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7fa229a5-5207-4f26-859a-ea5890b2e939", "id": 11}] 2026-02-25T15:00:38.281 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.279+0000 7fbda6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:38.281 INFO:teuthology.orchestra.run.trial072.stdout:11 2026-02-25T15:00:38.282 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 10 librados: watch_flush enter 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 10 librados: watch_flush exit 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 20 client.4176.objecter shutdown clearing up homeless session... 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 10 client.4176.objecter successfully canceled tick 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 >> v1:10.20.193.72:6800/2463505645 conn(0x7fbd8c079e50 legacy=0x7fbd8c09a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 10 monclient: shutdown 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 >> v1:10.20.193.21:6789/0 conn(0x7fbdc005df20 legacy=0x7fbdc0149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 shutdown_connections 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 >> 10.20.193.72:0/2640697597 conn(0x7fbdc00588d0 msgr2=0x7fbdc0181620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 shutdown_connections 2026-02-25T15:00:38.283 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 -- 10.20.193.72:0/2640697597 wait complete. 2026-02-25T15:00:38.284 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.280+0000 7fbdc4f83640 1 librados: shutdown 2026-02-25T15:00:38.290 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new d5cfb541-a088-4f8d-bfe4-923379407cfb 12 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: get_monmap_and_config 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: monmap: 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:38.352860+0000 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:38.352860+0000 2026-02-25T15:00:38.355 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 1 Processor -- start 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 1 -- start start 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: init 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-a con 0x7f120811c500 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.356 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-b con 0x7f120811e420 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-c con 0x7f120811ffc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208120d10 con 0x7f120811c500 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208120f00 con 0x7f120811e420 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12081210f0 con 0x7f120811ffc0 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.352+0000 7f120db8a640 10 monclient(hunting): authenticate will time out at 2984.086804s 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.353+0000 7f1206ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f120811e420 0x7f120811e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59672/0 (socket says 10.20.193.72:59672) 2026-02-25T15:00:38.357 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.353+0000 7f1206ffd640 1 -- 10.20.193.72:0/3707566988 learned_addr learned my addr 10.20.193.72:0/3707566988 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146325224 0 0) 0x7f12081210f0 con 0x7f120811ffc0 2026-02-25T15:00:38.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.381 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 10 monclient(hunting): my global_id is 4205 2026-02-25T15:00:38.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.379+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ec003610 con 0x7f120811ffc0 2026-02-25T15:00:38.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273932929 0 0) 0x7f1208120f00 con 0x7f120811e420 2026-02-25T15:00:38.382 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 10 monclient(hunting): my global_id is 4198 2026-02-25T15:00:38.383 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.381+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12081210f0 con 0x7f120811e420 2026-02-25T15:00:38.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3312102070 0 0) 0x7f11ec003610 con 0x7f120811ffc0 2026-02-25T15:00:38.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 >> v1:10.20.193.31:6789/0 conn(0x7f120811e420 legacy=0x7f120811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 >> v1:10.20.193.21:6789/0 conn(0x7f120811c500 legacy=0x7f120811c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.384 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 monclient: found mon.noname-c 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1208121380 con 0x7f120811ffc0 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11fc003170 con 0x7f120811ffc0 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f12067fc640 10 monclient: dump: 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.385 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f120db8a640 5 monclient: authenticate success, global_id 4205 2026-02-25T15:00:38.386 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.382+0000 7f120db8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11fc003470 con 0x7f120811ffc0 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 1 -- 10.20.193.72:0/3707566988 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11fc0038b0 con 0x7f120811ffc0 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f12067fc640 10 monclient: dump: 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.393 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f120db8a640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.383+0000 7f120db8a640 4 set_mon_vals no callback set 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: shutdown 2026-02-25T15:00:38.394 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- 10.20.193.72:0/3707566988 >> v1:10.20.193.68:6789/0 conn(0x7f120811ffc0 legacy=0x7f1208120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- 10.20.193.72:0/3707566988 shutdown_connections 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- 10.20.193.72:0/3707566988 >> 10.20.193.72:0/3707566988 conn(0x7f12080588d0 msgr2=0x7f1208058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- 10.20.193.72:0/3707566988 shutdown_connections 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- 10.20.193.72:0/3707566988 wait complete. 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: monmap: 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.395 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 librados: starting msgr at 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 librados: starting objecter 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 Processor -- start 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- start start 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 librados: setting wanted keys 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 librados: calling monclient init 2026-02-25T15:00:38.396 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: init 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-a con 0x7f120811c500 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-c con 0x7f120811e420 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient(hunting): picked mon.noname-b con 0x7f120811ffc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1208179880 con 0x7f120811c500 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120817aa60 con 0x7f120811ffc0 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120817bc40 con 0x7f120811e420 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.384+0000 7f120db8a640 10 monclient(hunting): authenticate will time out at 2984.118858s 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f1206ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f120811e420 0x7f1208176a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45088/0 (socket says 10.20.193.72:45088) 2026-02-25T15:00:38.397 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f1206ffd640 1 -- 10.20.193.72:0/3183786915 learned_addr learned my addr 10.20.193.72:0/3183786915 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter ms_handle_connect 0x7f120811ffc0 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter ms_handle_connect 0x7f120811e420 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter ms_handle_connect 0x7f120811c500 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.385+0000 7f11e3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687727300 0 0) 0x7f120817bc40 con 0x7f120811e420 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): my global_id is 4208 2026-02-25T15:00:38.398 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d8003610 con 0x7f120811e420 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 381105059 0 0) 0x7f120817aa60 con 0x7f120811ffc0 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): my global_id is 4201 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f120817bc40 con 0x7f120811ffc0 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216869314 0 0) 0x7f1208179880 con 0x7f120811c500 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 10 monclient(hunting): my global_id is 4182 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.386+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f120817aa60 con 0x7f120811c500 2026-02-25T15:00:38.399 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 797639786 0 0) 0x7f11d8003610 con 0x7f120811e420 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1208179880 con 0x7f120811e420 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11f80030f0 con 0x7f120811e420 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): dump: 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.400 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 238444232 0 0) 0x7f120817bc40 con 0x7f120811ffc0 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11d8003610 con 0x7f120811ffc0 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11fc002f90 con 0x7f120811ffc0 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.388+0000 7f11e3fff640 10 monclient(hunting): dump: 2026-02-25T15:00:38.401 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2140718384 0 0) 0x7f120817aa60 con 0x7f120811c500 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f120817bc40 con 0x7f120811c500 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11f4003010 con 0x7f120811c500 2026-02-25T15:00:38.402 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient(hunting): dump: 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.403 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 631615497 0 0) 0x7f1208179880 con 0x7f120811e420 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 >> v1:10.20.193.31:6789/0 conn(0x7f120811ffc0 legacy=0x7f1208178160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 >> v1:10.20.193.21:6789/0 conn(0x7f120811c500 legacy=0x7f1208130090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 monclient: found mon.c 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120817ce20 con 0x7f120811e420 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f11e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 5 monclient: authenticate success, global_id 4208 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 10 monclient: _renew_subs 2026-02-25T15:00:38.404 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f120817be10 con 0x7f120811e420 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 10 client.4208.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 10 monclient: _renew_subs 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f120817c3d0 con 0x7f120811e420 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.389+0000 7f120db8a640 1 librados: init done 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.390+0000 7f120db8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.390+0000 7f120db8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.390+0000 7f120db8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.405 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.390+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120818b5c0 con 0x7f120811e420 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11f80048d0 con 0x7f120811e420 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f11f8004c20 con 0x7f120811e420 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f1205ffb640 4 set_mon_vals no callback set 2026-02-25T15:00:38.407 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.394+0000 7f11e3fff640 10 monclient: dump: 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.397+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 2457156572 0 0) 0x7f11f801dec0 con 0x7f120811e420 2026-02-25T15:00:38.408 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f12077fe640 10 monclient: get_auth_request con 0x7f11d8079ef0 auth_method 0 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 4081331524 0 0) 0x7f11f805acf0 con 0x7f120811e420 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 10 client.4208.objecter ms_dispatch2 0x7f1208000b90 osd_map(14..14 src has 1..14) 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 3 client.4208.objecter handle_osd_map got epochs [14,14] > 0 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 3 client.4208.objecter handle_osd_map decoding full epoch 14 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 20 client.4208.objecter dump_active .. 0 homeless 2026-02-25T15:00:38.409 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.398+0000 7f11e3fff640 10 client.4208.objecter ms_handle_connect 0x7f11d8079ef0 2026-02-25T15:00:38.483 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.481+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f11f805f460 con 0x7f120811e420 2026-02-25T15:00:38.483 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.481+0000 7f11e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.483 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.481+0000 7f11e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:38.593 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.591+0000 7f120db8a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d5cfb541-a088-4f8d-bfe4-923379407cfb", "id": 12}] 2026-02-25T15:00:38.593 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.591+0000 7f120db8a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d5cfb541-a088-4f8d-bfe4-923379407cfb", "id": 12}] 2026-02-25T15:00:38.593 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.591+0000 7f120db8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.593 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.591+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d5cfb541-a088-4f8d-bfe4-923379407cfb", "id": 12} v 0) -- 0x7f120817cb40 con 0x7f120811e420 2026-02-25T15:00:38.609 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.608+0000 7f11e3fff640 1 -- 10.20.193.72:0/3183786915 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5cfb541-a088-4f8d-bfe4-923379407cfb", "id": 12}]=0 v15) ==== 113+0+3 (unknown 3547946683 0 944643765) 0x7f11f805ed60 con 0x7f120811e420 2026-02-25T15:00:38.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.608+0000 7f11e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d5cfb541-a088-4f8d-bfe4-923379407cfb", "id": 12}] 2026-02-25T15:00:38.610 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.608+0000 7f11e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:38.610 INFO:teuthology.orchestra.run.trial072.stdout:12 2026-02-25T15:00:38.611 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 10 librados: watch_flush enter 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 10 librados: watch_flush exit 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 20 client.4208.objecter shutdown clearing up homeless session... 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 10 client.4208.objecter successfully canceled tick 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 >> v1:10.20.193.72:6800/2463505645 conn(0x7f11d8079ef0 legacy=0x7f11d809a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 10 monclient: shutdown 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 >> v1:10.20.193.68:6789/0 conn(0x7f120811e420 legacy=0x7f1208176a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 shutdown_connections 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 >> 10.20.193.72:0/3183786915 conn(0x7f12080588d0 msgr2=0x7f1208059040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 shutdown_connections 2026-02-25T15:00:38.612 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 -- 10.20.193.72:0/3183786915 wait complete. 2026-02-25T15:00:38.613 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.609+0000 7f120db8a640 1 librados: shutdown 2026-02-25T15:00:38.618 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 9fbaf977-6060-408d-b78e-eb4bf0f920c4 13 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: get_monmap_and_config 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: monmap: 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.688 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:38.685936+0000 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:38.685936+0000 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 1 Processor -- start 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 1 -- start start 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: init 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.689 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-b con 0x7efd8c11e790 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-a con 0x7efd8c1406c0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.685+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-c con 0x7efd8c162250 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd9108b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c183fe0 con 0x7efd8c1406c0 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd9108b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c1851e0 con 0x7efd8c11e790 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd9108b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c1863e0 con 0x7efd8c162250 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd9108b640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd9108b640 10 monclient(hunting): authenticate will time out at 2984.420071s 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd8ad76640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7efd8c11e790 0x7efd8c11eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59696/0 (socket says 10.20.193.72:59696) 2026-02-25T15:00:38.690 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.686+0000 7efd8ad76640 1 -- 10.20.193.72:0/2250434896 learned_addr learned my addr 10.20.193.72:0/2250434896 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132961890 0 0) 0x7efd8c1863e0 con 0x7efd8c162250 2026-02-25T15:00:38.735 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 10 monclient(hunting): my global_id is 4211 2026-02-25T15:00:38.736 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.734+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd78003610 con 0x7efd8c162250 2026-02-25T15:00:38.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 384284850 0 0) 0x7efd78003610 con 0x7efd8c162250 2026-02-25T15:00:38.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 >> v1:10.20.193.31:6789/0 conn(0x7efd8c11e790 legacy=0x7efd8c11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 >> v1:10.20.193.21:6789/0 conn(0x7efd8c1406c0 legacy=0x7efd8c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.740 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 monclient: found mon.noname-c 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c187680 con 0x7efd8c162250 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efd7c003170 con 0x7efd8c162250 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: dump: 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.741 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 5 monclient: authenticate success, global_id 4211 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:38.742 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd7c0033f0 con 0x7efd8c162250 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 1 -- 10.20.193.72:0/2250434896 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efd7c003830 con 0x7efd8c162250 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd89d74640 10 monclient: dump: 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.743 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 4 set_mon_vals no callback set 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 10 monclient: shutdown 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.736+0000 7efd9108b640 1 -- 10.20.193.72:0/2250434896 >> v1:10.20.193.68:6789/0 conn(0x7efd8c162250 legacy=0x7efd8c1826e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- 10.20.193.72:0/2250434896 shutdown_connections 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- 10.20.193.72:0/2250434896 >> 10.20.193.72:0/2250434896 conn(0x7efd8c0588d0 msgr2=0x7efd8c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- 10.20.193.72:0/2250434896 shutdown_connections 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- 10.20.193.72:0/2250434896 wait complete. 2026-02-25T15:00:38.744 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient: build_initial_monmap 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient: monmap: 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.745 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 librados: starting msgr at 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 librados: starting objecter 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 Processor -- start 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- start start 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 librados: setting wanted keys 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 librados: calling monclient init 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient: init 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-c con 0x7efd8c11e790 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-b con 0x7efd8c1406c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:38.746 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient(hunting): picked mon.noname-a con 0x7efd8c162250 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c12e7d0 con 0x7efd8c162250 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c12f9d0 con 0x7efd8c1406c0 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c130bd0 con 0x7efd8c11e790 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.737+0000 7efd9108b640 10 monclient(hunting): authenticate will time out at 2984.471694s 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.738+0000 7efd8ad76640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7efd8c11e790 0x7efd8c1826c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45092/0 (socket says 10.20.193.72:45092) 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.738+0000 7efd8ad76640 1 -- 10.20.193.72:0/723586592 learned_addr learned my addr 10.20.193.72:0/723586592 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.738+0000 7efd6b7fe640 10 client.?.objecter ms_handle_connect 0x7efd8c11e790 2026-02-25T15:00:38.747 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.738+0000 7efd6b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656528447 0 0) 0x7efd8c130bd0 con 0x7efd8c11e790 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 10 monclient(hunting): my global_id is 4214 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.739+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd58003610 con 0x7efd8c11e790 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 394330007 0 0) 0x7efd58003610 con 0x7efd8c11e790 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd8c130bd0 con 0x7efd8c11e790 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efd80003010 con 0x7efd8c11e790 2026-02-25T15:00:38.750 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 10 monclient(hunting): dump: 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.751 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.742+0000 7efd6b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3069376695 0 0) 0x7efd8c130bd0 con 0x7efd8c11e790 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 >> v1:10.20.193.31:6789/0 conn(0x7efd8c1406c0 legacy=0x7efd8c160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 >> v1:10.20.193.21:6789/0 conn(0x7efd8c162250 legacy=0x7efd8c12cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 1 monclient: found mon.c 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c131e70 con 0x7efd8c11e790 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:38.752 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 5 monclient: authenticate success, global_id 4214 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 10 monclient: _renew_subs 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c12fc00 con 0x7efd8c11e790 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 10 client.4214.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 10 monclient: _renew_subs 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efd8c130240 con 0x7efd8c11e790 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.743+0000 7efd9108b640 1 librados: init done 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.744+0000 7efd9108b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.744+0000 7efd9108b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.744+0000 7efd9108b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.753 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.744+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c185770 con 0x7efd8c11e790 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efd800048d0 con 0x7efd8c11e790 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efd80004ce0 con 0x7efd8c11e790 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd6b7fe640 10 monclient: dump: 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.755 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.751+0000 7efd89573640 4 set_mon_vals no callback set 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.752+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7efd80004ec0 con 0x7efd8c11e790 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.752+0000 7efd8a575640 10 monclient: get_auth_request con 0x7efd58079d90 auth_method 0 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.752+0000 7efd6b7fe640 10 client.4214.objecter ms_handle_connect 0x7efd58079d90 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.753+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 77594317 0 0) 0x7efd8005af90 con 0x7efd8c11e790 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.753+0000 7efd6b7fe640 10 client.4214.objecter ms_dispatch2 0x7efd8c000b90 osd_map(15..15 src has 1..15) 2026-02-25T15:00:38.756 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.753+0000 7efd6b7fe640 3 client.4214.objecter handle_osd_map got epochs [15,15] > 0 2026-02-25T15:00:38.757 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.753+0000 7efd6b7fe640 3 client.4214.objecter handle_osd_map decoding full epoch 15 2026-02-25T15:00:38.757 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.753+0000 7efd6b7fe640 20 client.4214.objecter dump_active .. 0 homeless 2026-02-25T15:00:38.839 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.838+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7efd8005f700 con 0x7efd8c11e790 2026-02-25T15:00:38.839 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.838+0000 7efd6b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:38.840 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.838+0000 7efd6b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:38.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.947+0000 7efd9108b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9fbaf977-6060-408d-b78e-eb4bf0f920c4", "id": 13}] 2026-02-25T15:00:38.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.947+0000 7efd9108b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9fbaf977-6060-408d-b78e-eb4bf0f920c4", "id": 13}] 2026-02-25T15:00:38.949 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.947+0000 7efd9108b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:38.950 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.947+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9fbaf977-6060-408d-b78e-eb4bf0f920c4", "id": 13} v 0) -- 0x7efd8c130580 con 0x7efd8c11e790 2026-02-25T15:00:38.969 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.968+0000 7efd6b7fe640 1 -- 10.20.193.72:0/723586592 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fbaf977-6060-408d-b78e-eb4bf0f920c4", "id": 13}]=0 v16) ==== 113+0+3 (unknown 280439629 0 736921282) 0x7efd8005f000 con 0x7efd8c11e790 2026-02-25T15:00:38.969 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.968+0000 7efd6b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9fbaf977-6060-408d-b78e-eb4bf0f920c4", "id": 13}] 2026-02-25T15:00:38.969 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.968+0000 7efd6b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:38.970 INFO:teuthology.orchestra.run.trial072.stdout:13 2026-02-25T15:00:38.971 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 10 librados: watch_flush enter 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 10 librados: watch_flush exit 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 20 client.4214.objecter shutdown clearing up homeless session... 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 10 client.4214.objecter successfully canceled tick 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 >> v1:10.20.193.72:6800/2463505645 conn(0x7efd58079d90 legacy=0x7efd5809a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 10 monclient: shutdown 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 >> v1:10.20.193.68:6789/0 conn(0x7efd8c11e790 legacy=0x7efd8c1826c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 shutdown_connections 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 >> 10.20.193.72:0/723586592 conn(0x7efd8c0588d0 msgr2=0x7efd8c11f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:38.972 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 shutdown_connections 2026-02-25T15:00:38.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 -- 10.20.193.72:0/723586592 wait complete. 2026-02-25T15:00:38.973 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:38.969+0000 7efd9108b640 1 librados: shutdown 2026-02-25T15:00:38.979 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new 4874b628-9885-489b-b19d-bc2454b19c1d 14 2026-02-25T15:00:39.045 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.042+0000 7f53f55a3640 10 monclient: get_monmap_and_config 2026-02-25T15:00:39.045 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.042+0000 7f53f55a3640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.045 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.042+0000 7f53f55a3640 10 monclient: monmap: 2026-02-25T15:00:39.045 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:39.045 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:39.043586+0000 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:39.043586+0000 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 1 Processor -- start 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 1 -- start start 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient: init 2026-02-25T15:00:39.046 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-c con 0x7f53f011c500 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-b con 0x7f53f011e420 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-a con 0x7f53f011ffc0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f0120d10 con 0x7f53f011ffc0 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f0120f00 con 0x7f53f011e420 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f01210f0 con 0x7f53f011c500 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53f55a3640 10 monclient(hunting): authenticate will time out at 2984.777511s 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53ee7fc640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f53f011e420 0x7f53f011e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59700/0 (socket says 10.20.193.72:59700) 2026-02-25T15:00:39.047 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.043+0000 7f53ee7fc640 1 -- 10.20.193.72:0/3603710013 learned_addr learned my addr 10.20.193.72:0/3603710013 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090674017 0 0) 0x7f53f0120d10 con 0x7f53f011ffc0 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): my global_id is 4185 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53dc003610 con 0x7f53f011ffc0 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027396182 0 0) 0x7f53f0120f00 con 0x7f53f011e420 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.053 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 10 monclient(hunting): my global_id is 4204 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.045+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f0120d10 con 0x7f53f011e420 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 512832804 0 0) 0x7f53dc003610 con 0x7f53f011ffc0 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 >> v1:10.20.193.68:6789/0 conn(0x7f53f011c500 legacy=0x7f53f011c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 >> v1:10.20.193.31:6789/0 conn(0x7f53f011e420 legacy=0x7f53f011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 monclient: found mon.noname-a 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:00:39.054 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f0121380 con 0x7f53f011ffc0 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53e0003170 con 0x7f53f011ffc0 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: dump: 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.055 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.058 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.058 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.058 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.058 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53f55a3640 5 monclient: authenticate success, global_id 4185 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53f55a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53e00033f0 con 0x7f53f011ffc0 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 1 -- 10.20.193.72:0/3603710013 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53e0003830 con 0x7f53f011ffc0 2026-02-25T15:00:39.059 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53edffb640 10 monclient: dump: 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.060 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53f55a3640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.047+0000 7f53f55a3640 4 set_mon_vals no callback set 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: shutdown 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- 10.20.193.72:0/3603710013 >> v1:10.20.193.21:6789/0 conn(0x7f53f011ffc0 legacy=0x7f53f0120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- 10.20.193.72:0/3603710013 shutdown_connections 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- 10.20.193.72:0/3603710013 >> 10.20.193.72:0/3603710013 conn(0x7f53f00588d0 msgr2=0x7f53f0058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- 10.20.193.72:0/3603710013 shutdown_connections 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- 10.20.193.72:0/3603710013 wait complete. 2026-02-25T15:00:39.061 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: monmap: 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.062 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 librados: starting msgr at 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 librados: starting objecter 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 Processor -- start 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- start start 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 librados: setting wanted keys 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 librados: calling monclient init 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: init 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-b con 0x7f53f011c500 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-c con 0x7f53f011e420 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient(hunting): picked mon.noname-a con 0x7f53f011ffc0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.063 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f0179700 con 0x7f53f011ffc0 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f017a8e0 con 0x7f53f011c500 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f017bac0 con 0x7f53f011e420 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.048+0000 7f53f55a3640 10 monclient(hunting): authenticate will time out at 2984.782822s 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53eeffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f53f011c500 0x7f53f012fec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:59716/0 (socket says 10.20.193.72:59716) 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53eeffd640 1 -- 10.20.193.72:0/2536382471 learned_addr learned my addr 10.20.193.72:0/2536382471 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53cf7fe640 10 client.?.objecter ms_handle_connect 0x7f53f011c500 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53cf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53cf7fe640 10 client.?.objecter ms_handle_connect 0x7f53f011e420 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.049+0000 7f53cf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.064 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876290795 0 0) 0x7f53f017bac0 con 0x7f53f011e420 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): my global_id is 4217 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003610 con 0x7f53f011e420 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590739649 0 0) 0x7f53f017a8e0 con 0x7f53f011c500 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 10 monclient(hunting): my global_id is 4207 2026-02-25T15:00:39.065 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.050+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53f017bac0 con 0x7f53f011c500 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1791664996 0 0) 0x7f53bc003610 con 0x7f53f011e420 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53f017a8e0 con 0x7f53f011e420 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53d80030b0 con 0x7f53f011e420 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): dump: 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.069 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 356851729 0 0) 0x7f53f017bac0 con 0x7f53f011c500 2026-02-25T15:00:39.070 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53bc003610 con 0x7f53f011c500 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53e4002fd0 con 0x7f53f011c500 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.052+0000 7f53cf7fe640 10 monclient(hunting): dump: 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.071 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.053+0000 7f53cf7fe640 10 client.?.objecter ms_handle_connect 0x7f53f011ffc0 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.053+0000 7f53cf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1783985669 0 0) 0x7f53bc003610 con 0x7f53f011c500 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 >> v1:10.20.193.68:6789/0 conn(0x7f53f011e420 legacy=0x7f53f01768c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 >> v1:10.20.193.21:6789/0 conn(0x7f53f011ffc0 legacy=0x7f53f0177fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 1 monclient: found mon.b 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.072 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f017cca0 con 0x7f53f011c500 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 5 monclient: authenticate success, global_id 4207 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _renew_subs 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53f017bc90 con 0x7f53f011c500 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 client.4207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _renew_subs 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f53f017c250 con 0x7f53f011c500 2026-02-25T15:00:39.073 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 1 librados: init done 2026-02-25T15:00:39.074 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.074 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.074 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.074 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.054+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f018b5c0 con 0x7f53f011c500 2026-02-25T15:00:39.146 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53e40035c0 con 0x7f53f011c500 2026-02-25T15:00:39.146 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.146 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53e4004b90 con 0x7f53f011c500 2026-02-25T15:00:39.146 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.146 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53cf7fe640 10 monclient: dump: 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.147 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.148 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.144+0000 7f53ed7fa640 4 set_mon_vals no callback set 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.145+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7f53e401e040 con 0x7f53f011c500 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.146+0000 7f53ee7fc640 10 monclient: get_auth_request con 0x7f53bc079e40 auth_method 0 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.146+0000 7f53cf7fe640 10 client.4207.objecter ms_handle_connect 0x7f53bc079e40 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 2617624836 0 0) 0x7f53e405adf0 con 0x7f53f011c500 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 10 client.4207.objecter ms_dispatch2 0x7f53f0000b90 osd_map(16..16 src has 1..16) 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 3 client.4207.objecter handle_osd_map got epochs [16,16] > 0 2026-02-25T15:00:39.149 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 3 client.4207.objecter handle_osd_map decoding full epoch 16 2026-02-25T15:00:39.150 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 20 client.4207.objecter dump_active .. 0 homeless 2026-02-25T15:00:39.150 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f53e405f560 con 0x7f53f011c500 2026-02-25T15:00:39.150 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.150 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.147+0000 7f53cf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:39.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.257+0000 7f53f55a3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4874b628-9885-489b-b19d-bc2454b19c1d", "id": 14}] 2026-02-25T15:00:39.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.257+0000 7f53f55a3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4874b628-9885-489b-b19d-bc2454b19c1d", "id": 14}] 2026-02-25T15:00:39.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.257+0000 7f53f55a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.259 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.257+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd new", "uuid": "4874b628-9885-489b-b19d-bc2454b19c1d", "id": 14} v 0) -- 0x7f53f017c590 con 0x7f53f011c500 2026-02-25T15:00:39.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.308+0000 7f53cf7fe640 1 -- 10.20.193.72:0/2536382471 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4874b628-9885-489b-b19d-bc2454b19c1d", "id": 14}]=0 v17) ==== 113+0+3 (unknown 2951465102 0 1367428999) 0x7f53f017c590 con 0x7f53f011c500 2026-02-25T15:00:39.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.308+0000 7f53cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4874b628-9885-489b-b19d-bc2454b19c1d", "id": 14}] 2026-02-25T15:00:39.310 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.308+0000 7f53cf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:39.311 INFO:teuthology.orchestra.run.trial072.stdout:14 2026-02-25T15:00:39.312 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 10 librados: watch_flush enter 2026-02-25T15:00:39.312 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 10 librados: watch_flush exit 2026-02-25T15:00:39.312 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 20 client.4207.objecter shutdown clearing up homeless session... 2026-02-25T15:00:39.312 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 10 client.4207.objecter successfully canceled tick 2026-02-25T15:00:39.312 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 >> v1:10.20.193.72:6800/2463505645 conn(0x7f53bc079e40 legacy=0x7f53bc09a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 10 monclient: shutdown 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 >> v1:10.20.193.31:6789/0 conn(0x7f53f011c500 legacy=0x7f53f012fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 shutdown_connections 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 >> 10.20.193.72:0/2536382471 conn(0x7f53f00588d0 msgr2=0x7f53f011e880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 shutdown_connections 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 -- 10.20.193.72:0/2536382471 wait complete. 2026-02-25T15:00:39.313 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.309+0000 7f53f55a3640 1 librados: shutdown 2026-02-25T15:00:39.321 DEBUG:teuthology.orchestra.run.trial072:> sudo ceph --cluster ceph osd new bfa43094-6d74-4a8b-8ba1-4ae923d685a1 15 2026-02-25T15:00:39.387 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: get_monmap_and_config 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: monmap: 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T15:00:39.385787+0000 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T15:00:39.385787+0000 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.388 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 1 Processor -- start 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 1 -- start start 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: init 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-a con 0x7fb5c805ac30 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-c con 0x7fb5c811e330 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-b con 0x7fb5c811feb0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.389 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c8120b80 con 0x7fb5c805ac30 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c8120d70 con 0x7fb5c811feb0 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c8120f60 con 0x7fb5c811e330 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.385+0000 7fb5ceafe640 10 monclient(hunting): authenticate will time out at 2985.119729s 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.386+0000 7fb5cd2fb640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fb5c811e330 0x7fb5c811e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45118/0 (socket says 10.20.193.72:45118) 2026-02-25T15:00:39.390 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.386+0000 7fb5cd2fb640 1 -- 10.20.193.72:0/3241322926 learned_addr learned my addr 10.20.193.72:0/3241322926 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:39.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168372545 0 0) 0x7fb5c8120f60 con 0x7fb5c811e330 2026-02-25T15:00:39.426 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 10 monclient(hunting): my global_id is 4220 2026-02-25T15:00:39.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.424+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5b0003610 con 0x7fb5c811e330 2026-02-25T15:00:39.427 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3919510368 0 0) 0x7fb5c8120d70 con 0x7fb5c811feb0 2026-02-25T15:00:39.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 10 monclient(hunting): my global_id is 4210 2026-02-25T15:00:39.428 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.425+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c8120f60 con 0x7fb5c811feb0 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3644996926 0 0) 0x7fb5c8120b80 con 0x7fb5c805ac30 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 10 monclient(hunting): my global_id is 4188 2026-02-25T15:00:39.429 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.428+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5c8120d70 con 0x7fb5c805ac30 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2989412928 0 0) 0x7fb5b0003610 con 0x7fb5c811e330 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 >> v1:10.20.193.31:6789/0 conn(0x7fb5c811feb0 legacy=0x7fb5c8120330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 >> v1:10.20.193.21:6789/0 conn(0x7fb5c805ac30 legacy=0x7fb5c805b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 monclient: found mon.noname-c 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c81211f0 con 0x7fb5c811e330 2026-02-25T15:00:39.432 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb5bc002df0 con 0x7fb5c811e330 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ccafa640 10 monclient: dump: 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.433 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ceafe640 5 monclient: authenticate success, global_id 4220 2026-02-25T15:00:39.434 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.430+0000 7fb5ceafe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:39.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5bc003030 con 0x7fb5c811e330 2026-02-25T15:00:39.437 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 1 -- 10.20.193.72:0/3241322926 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb5bc003470 con 0x7fb5c811e330 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 4 set_mon_vals no callback set 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ccafa640 10 monclient: dump: 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.438 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 10 monclient: shutdown 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3241322926 >> v1:10.20.193.68:6789/0 conn(0x7fb5c811e330 legacy=0x7fb5c811e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3241322926 shutdown_connections 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3241322926 >> 10.20.193.72:0/3241322926 conn(0x7fb5c8058810 msgr2=0x7fb5c8058c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3241322926 shutdown_connections 2026-02-25T15:00:39.439 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.432+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3241322926 wait complete. 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient: monmap: 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:epoch 0 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 0.000000 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:created 0.000000 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 1 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.440 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 librados: starting msgr at 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 librados: starting objecter 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 Processor -- start 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 -- start start 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 librados: setting wanted keys 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 librados: calling monclient init 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient: init 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-c con 0x7fb5c805ac30 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.441 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-b con 0x7fb5c811e330 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient(hunting): picked mon.noname-a con 0x7fb5c811feb0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c8179ab0 con 0x7fb5c811feb0 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c817ac90 con 0x7fb5c811e330 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c817be70 con 0x7fb5c805ac30 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5ceafe640 10 monclient(hunting): authenticate will time out at 2985.167773s 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.433+0000 7fb5cdafc640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fb5c805ac30 0x7fb5c81302c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:45134/0 (socket says 10.20.193.72:45134) 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.434+0000 7fb5cdafc640 1 -- 10.20.193.72:0/3230455379 learned_addr learned my addr 10.20.193.72:0/3230455379 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.434+0000 7fb5b67fc640 10 client.?.objecter ms_handle_connect 0x7fb5c805ac30 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.434+0000 7fb5b67fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2007854316 0 0) 0x7fb5c817be70 con 0x7fb5c805ac30 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.442 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 10 monclient(hunting): my global_id is 4223 2026-02-25T15:00:39.443 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.435+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb598003610 con 0x7fb5c805ac30 2026-02-25T15:00:39.445 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.437+0000 7fb5b67fc640 10 client.?.objecter ms_handle_connect 0x7fb5c811feb0 2026-02-25T15:00:39.445 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.437+0000 7fb5b67fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.445 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496499275 0 0) 0x7fb598003610 con 0x7fb5c805ac30 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5c817be70 con 0x7fb5c805ac30 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb5b8003170 con 0x7fb5c805ac30 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): dump: 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.446 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985908020 0 0) 0x7fb5c8179ab0 con 0x7fb5c811feb0 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 10 monclient(hunting): my global_id is 4191 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.438+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb598003610 con 0x7fb5c811feb0 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3902122362 0 0) 0x7fb5c817be70 con 0x7fb5c805ac30 2026-02-25T15:00:39.447 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 >> v1:10.20.193.31:6789/0 conn(0x7fb5c811e330 legacy=0x7fb5c8176c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 >> v1:10.20.193.21:6789/0 conn(0x7fb5c811feb0 legacy=0x7fb5c8178390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 1 monclient: found mon.c 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c817d050 con 0x7fb5c805ac30 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 5 monclient: authenticate success, global_id 4223 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 10 monclient: _renew_subs 2026-02-25T15:00:39.448 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c8179c80 con 0x7fb5c805ac30 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 10 client.4223.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 10 monclient: _renew_subs 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5c817a270 con 0x7fb5c805ac30 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.439+0000 7fb5ceafe640 1 librados: init done 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.440+0000 7fb5ceafe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.440+0000 7fb5ceafe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.440+0000 7fb5ceafe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.449 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.440+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c8055260 con 0x7fb5c805ac30 2026-02-25T15:00:39.530 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5b8003520 con 0x7fb5c805ac30 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb5b8003b90 con 0x7fb5c805ac30 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b7fff640 4 set_mon_vals no callback set 2026-02-25T15:00:39.531 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.529+0000 7fb5b67fc640 10 monclient: dump: 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:epoch 1 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:election_strategy: 3 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.532 INFO:teuthology.orchestra.run.trial072.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.533 INFO:teuthology.orchestra.run.trial072.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.533 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:00:39.534 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.530+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7fb5b8003d70 con 0x7fb5c805ac30 2026-02-25T15:00:39.534 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.530+0000 7fb5cd2fb640 10 monclient: get_auth_request con 0x7fb598079e70 auth_method 0 2026-02-25T15:00:39.534 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.530+0000 7fb5b67fc640 10 client.4223.objecter ms_handle_connect 0x7fb598079e70 2026-02-25T15:00:39.539 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.537+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 3314439841 0 0) 0x7fb5b805af80 con 0x7fb5c805ac30 2026-02-25T15:00:39.539 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.537+0000 7fb5b67fc640 10 client.4223.objecter ms_dispatch2 0x7fb5c8000b90 osd_map(17..17 src has 1..17) 2026-02-25T15:00:39.539 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.537+0000 7fb5b67fc640 3 client.4223.objecter handle_osd_map got epochs [17,17] > 0 2026-02-25T15:00:39.539 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.537+0000 7fb5b67fc640 3 client.4223.objecter handle_osd_map decoding full epoch 17 2026-02-25T15:00:39.540 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.537+0000 7fb5b67fc640 20 client.4223.objecter dump_active .. 0 homeless 2026-02-25T15:00:39.555 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.554+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fb5b805f6f0 con 0x7fb5c805ac30 2026-02-25T15:00:39.555 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.554+0000 7fb5b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.555 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.554+0000 7fb5b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:39.666 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.664+0000 7fb5ceafe640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "bfa43094-6d74-4a8b-8ba1-4ae923d685a1", "id": 15}] 2026-02-25T15:00:39.666 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.664+0000 7fb5ceafe640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "bfa43094-6d74-4a8b-8ba1-4ae923d685a1", "id": 15}] 2026-02-25T15:00:39.666 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.664+0000 7fb5ceafe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.666 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.664+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd new", "uuid": "bfa43094-6d74-4a8b-8ba1-4ae923d685a1", "id": 15} v 0) -- 0x7fb5c817a5b0 con 0x7fb5c805ac30 2026-02-25T15:00:39.680 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.679+0000 7fb5b67fc640 1 -- 10.20.193.72:0/3230455379 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfa43094-6d74-4a8b-8ba1-4ae923d685a1", "id": 15}]=0 v18) ==== 113+0+3 (unknown 1318430074 0 1109645296) 0x7fb5b805eff0 con 0x7fb5c805ac30 2026-02-25T15:00:39.680 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.679+0000 7fb5b67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "bfa43094-6d74-4a8b-8ba1-4ae923d685a1", "id": 15}] 2026-02-25T15:00:39.681 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.679+0000 7fb5b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:39.681 INFO:teuthology.orchestra.run.trial072.stdout:15 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 10 librados: watch_flush enter 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 10 librados: watch_flush exit 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 20 client.4223.objecter shutdown clearing up homeless session... 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 10 client.4223.objecter successfully canceled tick 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 >> v1:10.20.193.72:6800/2463505645 conn(0x7fb598079e70 legacy=0x7fb59809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 10 monclient: shutdown 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 >> v1:10.20.193.68:6789/0 conn(0x7fb5c805ac30 legacy=0x7fb5c81302c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 shutdown_connections 2026-02-25T15:00:39.683 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 >> 10.20.193.72:0/3230455379 conn(0x7fb5c8058810 msgr2=0x7fb5c805c950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:39.684 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 shutdown_connections 2026-02-25T15:00:39.684 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 -- 10.20.193.72:0/3230455379 wait complete. 2026-02-25T15:00:39.684 INFO:teuthology.orchestra.run.trial072.stderr:2026-02-25T15:00:39.680+0000 7fb5ceafe640 1 librados: shutdown 2026-02-25T15:00:39.690 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.691 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T15:00:39.691 DEBUG:teuthology.orchestra.run.trial021:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-25T15:00:39.693 INFO:tasks.ceph.osd.0:Started 2026-02-25T15:00:39.693 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.694 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-25T15:00:39.694 DEBUG:teuthology.orchestra.run.trial021:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-25T15:00:39.696 INFO:tasks.ceph.osd.4:Started 2026-02-25T15:00:39.696 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.697 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-25T15:00:39.697 DEBUG:teuthology.orchestra.run.trial021:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-25T15:00:39.699 INFO:tasks.ceph.osd.8:Started 2026-02-25T15:00:39.699 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.699 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-25T15:00:39.700 DEBUG:teuthology.orchestra.run.trial021:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-25T15:00:39.702 INFO:tasks.ceph.osd.12:Started 2026-02-25T15:00:39.702 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.702 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T15:00:39.702 DEBUG:teuthology.orchestra.run.trial031:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-25T15:00:39.705 INFO:tasks.ceph.osd.1:Started 2026-02-25T15:00:39.705 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.706 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-25T15:00:39.706 DEBUG:teuthology.orchestra.run.trial031:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-25T15:00:39.708 INFO:tasks.ceph.osd.5:Started 2026-02-25T15:00:39.709 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.709 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-25T15:00:39.709 DEBUG:teuthology.orchestra.run.trial031:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-25T15:00:39.712 INFO:tasks.ceph.osd.9:Started 2026-02-25T15:00:39.712 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.712 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-25T15:00:39.712 DEBUG:teuthology.orchestra.run.trial031:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-25T15:00:39.715 INFO:tasks.ceph.osd.13:Started 2026-02-25T15:00:39.715 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.715 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T15:00:39.715 DEBUG:teuthology.orchestra.run.trial068:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-25T15:00:39.718 INFO:tasks.ceph.osd.2:Started 2026-02-25T15:00:39.718 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.718 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-25T15:00:39.718 DEBUG:teuthology.orchestra.run.trial068:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-25T15:00:39.721 INFO:tasks.ceph.osd.6:Started 2026-02-25T15:00:39.721 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.721 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-25T15:00:39.721 DEBUG:teuthology.orchestra.run.trial068:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-25T15:00:39.724 INFO:tasks.ceph.osd.10:Started 2026-02-25T15:00:39.724 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.724 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-25T15:00:39.724 DEBUG:teuthology.orchestra.run.trial068:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-25T15:00:39.727 INFO:tasks.ceph.osd.14:Started 2026-02-25T15:00:39.727 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.727 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-25T15:00:39.727 DEBUG:teuthology.orchestra.run.trial072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-25T15:00:39.730 INFO:tasks.ceph.osd.3:Started 2026-02-25T15:00:39.730 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.730 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-25T15:00:39.731 DEBUG:teuthology.orchestra.run.trial072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-25T15:00:39.733 INFO:tasks.ceph.osd.7:Started 2026-02-25T15:00:39.733 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.733 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-25T15:00:39.733 DEBUG:teuthology.orchestra.run.trial072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-25T15:00:39.735 INFO:tasks.ceph.osd.11:Started 2026-02-25T15:00:39.736 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-25T15:00:39.736 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-25T15:00:39.736 DEBUG:teuthology.orchestra.run.trial072:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-25T15:00:39.738 INFO:tasks.ceph.osd.15:Started 2026-02-25T15:00:39.739 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:00:39.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 10 monclient: get_monmap_and_config 2026-02-25T15:00:39.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 10 monclient: monmap: 2026-02-25T15:00:39.809 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:39.809 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:00:39.807957+0000 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:00:39.807957+0000 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 1 Processor -- start 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 1 -- start start 2026-02-25T15:00:39.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.806+0000 7f2e10773640 10 monclient: init 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-c con 0x7f2e08058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-a con 0x7f2e080b0410 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-b con 0x7f2e081626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e081655c0 con 0x7f2e080b0410 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080b12b0 con 0x7f2e081626a0 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080b1590 con 0x7f2e08058da0 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e10773640 10 monclient(hunting): authenticate will time out at 2983.400249s 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e0dce7640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f2e080b0410 0x7f2e08164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40556/0 (socket says 10.20.193.21:40556) 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.807+0000 7f2e0dce7640 1 -- 10.20.193.21:0/3040365979 learned_addr learned my addr 10.20.193.21:0/3040365979 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621329051 0 0) 0x7f2e080b12b0 con 0x7f2e081626a0 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.814 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): my global_id is 4213 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df0003610 con 0x7f2e081626a0 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1259345894 0 0) 0x7f2e080b1590 con 0x7f2e08058da0 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): my global_id is 4226 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e080b12b0 con 0x7f2e08058da0 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997160584 0 0) 0x7f2e081655c0 con 0x7f2e080b0410 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.815 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.816 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.816 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 10 monclient(hunting): my global_id is 4194 2026-02-25T15:00:39.816 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.809+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e080b1590 con 0x7f2e080b0410 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245320861 0 0) 0x7f2df0003610 con 0x7f2e081626a0 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 >> v1:10.20.193.68:6789/0 conn(0x7f2e08058da0 legacy=0x7f2e081647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 >> v1:10.20.193.21:6789/0 conn(0x7f2e080b0410 legacy=0x7f2e08164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 monclient: found mon.noname-b 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080b1870 con 0x7f2e081626a0 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e04003170 con 0x7f2e081626a0 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e0d4e6640 10 monclient: dump: 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.823 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e10773640 5 monclient: authenticate success, global_id 4213 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.811+0000 7f2e10773640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e04003340 con 0x7f2e081626a0 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 1 -- 10.20.193.21:0/3040365979 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e04003780 con 0x7f2e081626a0 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.824 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e0d4e6640 10 monclient: dump: 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 4 set_mon_vals no callback set 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 10 monclient: shutdown 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 1 -- 10.20.193.21:0/3040365979 >> v1:10.20.193.31:6789/0 conn(0x7f2e081626a0 legacy=0x7f2e081c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 1 -- 10.20.193.21:0/3040365979 shutdown_connections 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 1 -- 10.20.193.21:0/3040365979 >> 10.20.193.21:0/3040365979 conn(0x7f2e080b65f0 msgr2=0x7f2e080b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 1 -- 10.20.193.21:0/3040365979 shutdown_connections 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.812+0000 7f2e10773640 1 -- 10.20.193.21:0/3040365979 wait complete. 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient: build_initial_monmap 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient: monmap: 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:39.826 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 librados: starting msgr at 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 librados: starting objecter 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 Processor -- start 2026-02-25T15:00:39.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 -- start start 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 librados: setting wanted keys 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 librados: calling monclient init 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient: init 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-a con 0x7f2e08058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-c con 0x7f2e080b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient(hunting): picked mon.noname-b con 0x7f2e081626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0814c080 con 0x7f2e08058da0 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0814bb20 con 0x7f2e081626a0 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0813a5b0 con 0x7f2e080b0410 2026-02-25T15:00:39.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.813+0000 7f2e10773640 10 monclient(hunting): authenticate will time out at 2983.406944s 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2e0e4e8640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f2e08058da0 0x7f2e08139d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40562/0 (socket says 10.20.193.21:40562) 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2e0e4e8640 1 -- 10.20.193.21:0/1340898756 learned_addr learned my addr 10.20.193.21:0/1340898756 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter ms_handle_connect 0x7f2e08058da0 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter ms_handle_connect 0x7f2e081626a0 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter ms_handle_connect 0x7f2e080b0410 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.814+0000 7f2deeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721812149 0 0) 0x7f2e0814c080 con 0x7f2e08058da0 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): my global_id is 4197 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dd8003610 con 0x7f2e08058da0 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108626696 0 0) 0x7f2e0814bb20 con 0x7f2e081626a0 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): my global_id is 4216 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0814c080 con 0x7f2e081626a0 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114736467 0 0) 0x7f2e0813a5b0 con 0x7f2e080b0410 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:00:39.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 10 monclient(hunting): my global_id is 4229 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.815+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0814bb20 con 0x7f2e080b0410 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1228974280 0 0) 0x7f2e0814bb20 con 0x7f2e080b0410 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e0813a5b0 con 0x7f2e080b0410 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dfc003060 con 0x7f2e080b0410 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): dump: 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.831 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1403378956 0 0) 0x7f2e0814c080 con 0x7f2e081626a0 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e0814bb20 con 0x7f2e081626a0 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e04003690 con 0x7f2e081626a0 2026-02-25T15:00:39.832 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.818+0000 7f2deeffd640 10 monclient(hunting): dump: 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.833 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 556561870 0 0) 0x7f2dd8003610 con 0x7f2e08058da0 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e0814c080 con 0x7f2e08058da0 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2df8003190 con 0x7f2e08058da0 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.819+0000 7f2deeffd640 10 monclient(hunting): dump: 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.834 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.835 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.835 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.835 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.835 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3116267984 0 0) 0x7f2e0813a5b0 con 0x7f2e080b0410 2026-02-25T15:00:39.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 >> v1:10.20.193.31:6789/0 conn(0x7f2e081626a0 legacy=0x7f2e08131e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 >> v1:10.20.193.21:6789/0 conn(0x7f2e08058da0 legacy=0x7f2e08139d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 1 monclient: found mon.c 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0813a890 con 0x7f2e080b0410 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 10 monclient: _finish_auth 0 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2deeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 5 monclient: authenticate success, global_id 4229 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 10 monclient: _renew_subs 2026-02-25T15:00:39.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0813ab70 con 0x7f2e080b0410 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 10 monclient: _renew_subs 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e0813b130 con 0x7f2e080b0410 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.820+0000 7f2e10773640 1 librados: init done 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.821+0000 7f2e10773640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.821+0000 7f2e10773640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.821+0000 7f2e10773640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.821+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e080b6d40 con 0x7f2e080b0410 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2dfc003200 con 0x7f2e080b0410 2026-02-25T15:00:39.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dfc004af0 con 0x7f2e080b0410 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2deeffd640 10 monclient: dump: 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:39.840 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.828+0000 7f2e0cce5640 4 set_mon_vals no callback set 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.829+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7f2dfc01dfa0 con 0x7f2e080b0410 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.830+0000 7f2e0e4e8640 10 monclient: get_auth_request con 0x7f2dd8079fb0 auth_method 0 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.830+0000 7f2deeffd640 10 client.4229.objecter ms_handle_connect 0x7f2dd8079fb0 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.831+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 656321336 0 0) 0x7f2dfc05ab20 con 0x7f2e080b0410 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.831+0000 7f2deeffd640 10 client.4229.objecter ms_dispatch2 0x7f2e08000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.831+0000 7f2deeffd640 3 client.4229.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.831+0000 7f2deeffd640 3 client.4229.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:00:39.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.831+0000 7f2deeffd640 20 client.4229.objecter dump_active .. 0 homeless 2026-02-25T15:00:39.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.917+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f2dfc05f290 con 0x7f2e080b0410 2026-02-25T15:00:39.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.918+0000 7f2deeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:39.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:39.918+0000 7f2deeffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:40.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.027+0000 7f2e10773640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:40.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.027+0000 7f2e10773640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:40.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.027+0000 7f2e10773640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:00:40.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.027+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e080b6a60 con 0x7f2e080b0410 2026-02-25T15:00:40.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.047+0000 7f2deeffd640 1 -- 10.20.193.21:0/1340898756 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 302409104) 0x7f2dfc05eb90 con 0x7f2e080b0410 2026-02-25T15:00:40.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.047+0000 7f2deeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:40.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.047+0000 7f2deeffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:40.051 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:00:40.051 INFO:teuthology.orchestra.run.trial021.stdout:{"epoch":18,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:00:39.668731+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:00:40.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 10 librados: watch_flush enter 2026-02-25T15:00:40.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 10 librados: watch_flush exit 2026-02-25T15:00:40.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 20 client.4229.objecter shutdown clearing up homeless session... 2026-02-25T15:00:40.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 10 client.4229.objecter successfully canceled tick 2026-02-25T15:00:40.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 >> v1:10.20.193.72:6800/2463505645 conn(0x7f2dd8079fb0 legacy=0x7f2dd809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 10 monclient: shutdown 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 >> v1:10.20.193.68:6789/0 conn(0x7f2e080b0410 legacy=0x7f2e0814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 shutdown_connections 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 >> 10.20.193.21:0/1340898756 conn(0x7f2e080b65f0 msgr2=0x7f2e08055980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 shutdown_connections 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 -- 10.20.193.21:0/1340898756 wait complete. 2026-02-25T15:00:40.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:00:40.050+0000 7f2e10773640 1 librados: shutdown 2026-02-25T15:00:40.062 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-25T15:00:40.062 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-25T15:00:41.673 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.730+0000 7fecc92b1640 10 monclient: get_monmap_and_config 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.730+0000 7fecc92b1640 10 monclient: build_initial_monmap 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.730+0000 7fecc92b1640 10 monclient: monmap: 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T15:00:41.732386+0000 2026-02-25T15:00:41.733 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T15:00:41.732386+0000 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:41.734 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.736 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 1 Processor -- start 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 1 -- start start 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient: init 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-b con 0x7fecc4058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-c con 0x7fecc40b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-a con 0x7fecc41626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc41655c0 con 0x7fecc41626a0 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40b12b0 con 0x7fecc4058da0 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40b1590 con 0x7fecc40b0410 2026-02-25T15:00:41.737 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.731+0000 7fecc92b1640 10 monclient(hunting): authenticate will time out at 2985.324639s 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.732+0000 7fecc2ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fecc4058da0 0x7fecc41647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:49180/0 (socket says 10.20.193.21:49180) 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.732+0000 7fecc2ffd640 1 -- 10.20.193.21:0/2998845143 learned_addr learned my addr 10.20.193.21:0/2998845143 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315827056 0 0) 0x7fecc40b12b0 con 0x7fecc4058da0 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): my global_id is 4219 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecb0003610 con 0x7fecc4058da0 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203993891 0 0) 0x7fecc40b1590 con 0x7fecc40b0410 2026-02-25T15:00:41.738 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 10 monclient(hunting): my global_id is 4232 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.733+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc40b12b0 con 0x7fecc40b0410 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655221530 0 0) 0x7fecc41655c0 con 0x7fecc41626a0 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 10 monclient(hunting): my global_id is 4200 2026-02-25T15:00:41.739 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.734+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc40b1590 con 0x7fecc41626a0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 487722102 0 0) 0x7fecb0003610 con 0x7fecc4058da0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 >> v1:10.20.193.68:6789/0 conn(0x7fecc40b0410 legacy=0x7fecc4164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 >> v1:10.20.193.21:6789/0 conn(0x7fecc41626a0 legacy=0x7fecc41c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 monclient: found mon.noname-b 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40b1870 con 0x7fecc4058da0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:00:41.744 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecb8002df0 con 0x7fecc4058da0 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc1ffb640 10 monclient: dump: 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.745 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc92b1640 5 monclient: authenticate success, global_id 4219 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.735+0000 7fecc92b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fecb8002fc0 con 0x7fecc4058da0 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 1 -- 10.20.193.21:0/2998845143 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecb8003400 con 0x7fecc4058da0 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:41.746 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc1ffb640 10 monclient: dump: 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc92b1640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.736+0000 7fecc92b1640 4 set_mon_vals no callback set 2026-02-25T15:00:41.747 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 10 monclient: shutdown 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 -- 10.20.193.21:0/2998845143 >> v1:10.20.193.31:6789/0 conn(0x7fecc4058da0 legacy=0x7fecc41647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 -- 10.20.193.21:0/2998845143 shutdown_connections 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 -- 10.20.193.21:0/2998845143 >> 10.20.193.21:0/2998845143 conn(0x7fecc40b65f0 msgr2=0x7fecc40b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 -- 10.20.193.21:0/2998845143 shutdown_connections 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 -- 10.20.193.21:0/2998845143 wait complete. 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 10 monclient: build_initial_monmap 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 10 monclient: monmap: 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:41.748 INFO:teuthology.misc.health.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:created 0.000000 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 1 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.737+0000 7fecc92b1640 1 librados: starting msgr at 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 librados: starting objecter 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 Processor -- start 2026-02-25T15:00:41.749 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 -- start start 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 librados: setting wanted keys 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 librados: calling monclient init 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient: init 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-c con 0x7fecc4058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-b con 0x7fecc40b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient(hunting): picked mon.noname-a con 0x7fecc41626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc4139810 con 0x7fecc41626a0 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc4056ab0 con 0x7fecc40b0410 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc4056d90 con 0x7fecc4058da0 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:41.750 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc92b1640 10 monclient(hunting): authenticate will time out at 2985.331610s 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc27fc640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fecc40b0410 0x7fecc4139100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:49186/0 (socket says 10.20.193.21:49186) 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc27fc640 1 -- 10.20.193.21:0/478265066 learned_addr learned my addr 10.20.193.21:0/478265066 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.738+0000 7fecc37fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fecc41626a0 0x7fecc41f6ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40578/0 (socket says 10.20.193.21:40578) 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter ms_handle_connect 0x7fecc40b0410 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter ms_handle_connect 0x7fecc41626a0 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter ms_handle_connect 0x7fecc4058da0 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.739+0000 7feca37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971527545 0 0) 0x7fecc4056ab0 con 0x7fecc40b0410 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.751 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): my global_id is 4222 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec90003610 con 0x7fecc40b0410 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867499837 0 0) 0x7fecc4139810 con 0x7fecc41626a0 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): my global_id is 4203 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc4056ab0 con 0x7fecc41626a0 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902638821 0 0) 0x7fecc4056d90 con 0x7fecc4058da0 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:41.752 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:41.753 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:41.753 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 10 monclient(hunting): my global_id is 4235 2026-02-25T15:00:41.753 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.740+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc4139810 con 0x7fecc4058da0 2026-02-25T15:00:41.756 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 747307724 0 0) 0x7fec90003610 con 0x7fecc40b0410 2026-02-25T15:00:41.756 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecc4056d90 con 0x7fecc40b0410 2026-02-25T15:00:41.756 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecac003190 con 0x7fecc40b0410 2026-02-25T15:00:41.756 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:41.756 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.757 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.742+0000 7feca37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 560306206 0 0) 0x7fecc4056ab0 con 0x7fecc41626a0 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec90003610 con 0x7fecc41626a0 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecb4003300 con 0x7fecc41626a0 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.758 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3541455654 0 0) 0x7fecc4139810 con 0x7fecc4058da0 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecc4056ab0 con 0x7fecc4058da0 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecb8003310 con 0x7fecc4058da0 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.743+0000 7feca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:41.759 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 770873835 0 0) 0x7fecc4056d90 con 0x7fecc40b0410 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 >> v1:10.20.193.68:6789/0 conn(0x7fecc4058da0 legacy=0x7fecc41f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 >> v1:10.20.193.21:6789/0 conn(0x7fecc41626a0 legacy=0x7fecc41f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.760 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 1 monclient: found mon.b 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc4057070 con 0x7fecc40b0410 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7feca37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 5 monclient: authenticate success, global_id 4222 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 10 monclient: _renew_subs 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fecc4057350 con 0x7fecc40b0410 2026-02-25T15:00:41.761 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 10 client.4222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 10 monclient: _renew_subs 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fecc4057910 con 0x7fecc40b0410 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.744+0000 7fecc92b1640 1 librados: init done 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.745+0000 7fecc92b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.745+0000 7fecc92b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.745+0000 7fecc92b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.745+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc4059f70 con 0x7fecc40b0410 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fecac0039b0 con 0x7fecc40b0410 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fecac003c20 con 0x7fecc40b0410 2026-02-25T15:00:41.762 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7feca37fe640 10 monclient: dump: 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:41.763 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:41.764 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.750+0000 7fecc17fa640 4 set_mon_vals no callback set 2026-02-25T15:00:41.764 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.753+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7fecac003be0 con 0x7fecc40b0410 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.754+0000 7fecc2ffd640 10 monclient: get_auth_request con 0x7fec9007a0f0 auth_method 0 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.754+0000 7feca37fe640 10 client.4222.objecter ms_handle_connect 0x7fec9007a0f0 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.755+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 656321336 0 0) 0x7fecac05ad70 con 0x7fecc40b0410 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.755+0000 7feca37fe640 10 client.4222.objecter ms_dispatch2 0x7fecc4000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.755+0000 7feca37fe640 3 client.4222.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.755+0000 7feca37fe640 3 client.4222.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:00:41.765 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.755+0000 7feca37fe640 20 client.4222.objecter dump_active .. 0 homeless 2026-02-25T15:00:41.845 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.843+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fecac05f4e0 con 0x7fecc40b0410 2026-02-25T15:00:41.845 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.843+0000 7feca37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:41.846 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.843+0000 7feca37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:41.954 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.951+0000 7fecc92b1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:41.954 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.951+0000 7fecc92b1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:41.954 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.951+0000 7fecc92b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:00:41.954 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.951+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecc4059c90 con 0x7fecc40b0410 2026-02-25T15:00:41.975 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.973+0000 7feca37fe640 1 -- 10.20.193.21:0/478265066 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 302409104) 0x7fecac05ede0 con 0x7fecc40b0410 2026-02-25T15:00:41.975 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.973+0000 7feca37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:41.975 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.973+0000 7feca37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:41.975 INFO:teuthology.misc.health.trial021.stdout: 2026-02-25T15:00:41.975 INFO:teuthology.misc.health.trial021.stdout:{"epoch":18,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:00:39.668731+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.975+0000 7fecc92b1640 10 librados: watch_flush enter 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.975+0000 7fecc92b1640 10 librados: watch_flush exit 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.975+0000 7fecc92b1640 20 client.4222.objecter shutdown clearing up homeless session... 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.975+0000 7fecc92b1640 10 client.4222.objecter successfully canceled tick 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 >> v1:10.20.193.72:6800/2463505645 conn(0x7fec9007a0f0 legacy=0x7fec9009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 10 monclient: shutdown 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 >> v1:10.20.193.31:6789/0 conn(0x7fecc40b0410 legacy=0x7fecc4139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 shutdown_connections 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 >> 10.20.193.21:0/478265066 conn(0x7fecc40b65f0 msgr2=0x7fecc40af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 shutdown_connections 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 -- 10.20.193.21:0/478265066 wait complete. 2026-02-25T15:00:41.978 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:41.976+0000 7fecc92b1640 1 librados: shutdown 2026-02-25T15:00:41.985 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:00:49.598 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.659+0000 7f11094b9640 10 monclient: get_monmap_and_config 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.659+0000 7f11094b9640 10 monclient: build_initial_monmap 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.659+0000 7f11094b9640 10 monclient: monmap: 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T15:00:49.660304+0000 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T15:00:49.660304+0000 2026-02-25T15:00:49.661 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:49.662 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.662 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:49.662 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:49.662 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:49.662 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.664 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 1 Processor -- start 2026-02-25T15:00:49.664 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 1 -- start start 2026-02-25T15:00:49.664 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient: init 2026-02-25T15:00:49.664 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:49.664 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-c con 0x7f11041603a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-a con 0x7f1104056690 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-b con 0x7f11041613d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1104161850 con 0x7f1104056690 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11040592d0 con 0x7f11041613d0 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11040595b0 con 0x7f11041603a0 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.660+0000 7f11094b9640 10 monclient(hunting): authenticate will time out at 2993.252694s 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.661+0000 7f11027fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1104056690 0x7f1104057f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40284/0 (socket says 10.20.193.21:40284) 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.661+0000 7f11027fc640 1 -- 10.20.193.21:0/1834263357 learned_addr learned my addr 10.20.193.21:0/1834263357 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.661+0000 7f11037fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f11041613d0 0x7f11040b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:56872/0 (socket says 10.20.193.21:56872) 2026-02-25T15:00:49.665 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846353561 0 0) 0x7f11040592d0 con 0x7f11041613d0 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): my global_id is 4225 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10f0003610 con 0x7f11041613d0 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760169328 0 0) 0x7f10ec002910 con 0x7f1104056690 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 10 monclient(hunting): my global_id is 4206 2026-02-25T15:00:49.666 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.662+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11040592d0 con 0x7f1104056690 2026-02-25T15:00:49.670 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 640363427 0 0) 0x7f10f0003610 con 0x7f11041613d0 2026-02-25T15:00:49.670 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 >> v1:10.20.193.68:6789/0 conn(0x7f11041603a0 legacy=0x7f1104160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:00:49.670 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 >> v1:10.20.193.21:6789/0 conn(0x7f1104056690 legacy=0x7f1104057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 monclient: found mon.noname-b 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1104059890 con 0x7f11041613d0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: _finish_auth 0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10f4003170 con 0x7f11041613d0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:00:49.671 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f1101ffb640 10 monclient: dump: 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f11094b9640 5 monclient: authenticate success, global_id 4225 2026-02-25T15:00:49.672 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.664+0000 7f11094b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10f4003340 con 0x7f11041613d0 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 1 -- 10.20.193.21:0/1834263357 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10f4003780 con 0x7f11041613d0 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f1101ffb640 10 monclient: dump: 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.673 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 4 set_mon_vals no callback set 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 10 monclient: shutdown 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 1 -- 10.20.193.21:0/1834263357 >> v1:10.20.193.31:6789/0 conn(0x7f11041613d0 legacy=0x7f11040b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 1 -- 10.20.193.21:0/1834263357 shutdown_connections 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 1 -- 10.20.193.21:0/1834263357 >> 10.20.193.21:0/1834263357 conn(0x7f11040b65f0 msgr2=0x7f11040b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:49.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 1 -- 10.20.193.21:0/1834263357 shutdown_connections 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.665+0000 7f11094b9640 1 -- 10.20.193.21:0/1834263357 wait complete. 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 10 monclient: build_initial_monmap 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 10 monclient: monmap: 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:created 0.000000 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 1 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:49.675 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 librados: starting msgr at 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 librados: starting objecter 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 Processor -- start 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 -- start start 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 librados: setting wanted keys 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 1 librados: calling monclient init 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 10 monclient: init 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.666+0000 7f11094b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-c con 0x7f1104056690 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:49.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-a con 0x7f11041603a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 10 monclient(hunting): picked mon.noname-b con 0x7f11041613d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11041352f0 con 0x7f11041603a0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1104134290 con 0x7f11041613d0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11040b1b40 con 0x7f1104056690 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11094b9640 10 monclient(hunting): authenticate will time out at 2993.259074s 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11027fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f11041603a0 0x7f11040b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40294/0 (socket says 10.20.193.21:40294) 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11027fc640 1 -- 10.20.193.21:0/1266397500 learned_addr learned my addr 10.20.193.21:0/1266397500 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f11037fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f11041613d0 0x7f1104137810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:56886/0 (socket says 10.20.193.21:56886) 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter ms_handle_connect 0x7f11041603a0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter ms_handle_connect 0x7f11041613d0 2026-02-25T15:00:49.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter ms_handle_connect 0x7f1104056690 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.667+0000 7f10e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463627671 0 0) 0x7f11040b1b40 con 0x7f1104056690 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): my global_id is 4238 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10d0003610 con 0x7f1104056690 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665624761 0 0) 0x7f11041352f0 con 0x7f11041603a0 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:49.678 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:49.679 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 10 monclient(hunting): my global_id is 4209 2026-02-25T15:00:49.679 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.668+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11040b1b40 con 0x7f11041603a0 2026-02-25T15:00:49.681 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218394505 0 0) 0x7f1104134290 con 0x7f11041613d0 2026-02-25T15:00:49.681 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:49.681 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:49.681 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 10 monclient(hunting): my global_id is 4228 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.670+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11041352f0 con 0x7f11041613d0 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 875020475 0 0) 0x7f11040b1b40 con 0x7f11041603a0 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1104134290 con 0x7f11041603a0 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10ec0031c0 con 0x7f11041603a0 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.682 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2705894251 0 0) 0x7f10d0003610 con 0x7f1104056690 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11040b1b40 con 0x7f1104056690 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10f8002f70 con 0x7f1104056690 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:49.683 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.671+0000 7f10e37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.684 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1275018705 0 0) 0x7f11041352f0 con 0x7f11041613d0 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10d0003610 con 0x7f11041613d0 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10f4003690 con 0x7f11041613d0 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.672+0000 7f10e37fe640 10 monclient(hunting): dump: 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.685 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 952655884 0 0) 0x7f1104134290 con 0x7f11041603a0 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 >> v1:10.20.193.68:6789/0 conn(0x7f1104056690 legacy=0x7f110413a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 >> v1:10.20.193.31:6789/0 conn(0x7f11041613d0 legacy=0x7f1104137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 1 monclient: found mon.a 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11041f7d10 con 0x7f11041603a0 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:49.686 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f10e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 5 monclient: authenticate success, global_id 4209 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _renew_subs 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1104134530 con 0x7f11041603a0 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 client.4209.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _renew_subs 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1104134af0 con 0x7f11041603a0 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 1 librados: init done 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:49.687 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:49.688 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:49.688 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.673+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f110415f0c0 con 0x7f11041603a0 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f10ec0048d0 con 0x7f11041603a0 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f10ec004c20 con 0x7f11041603a0 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f10e37fe640 10 monclient: dump: 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:49.689 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.683+0000 7f11017fa640 4 set_mon_vals no callback set 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.684+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7f10ec01e0d0 con 0x7f11041603a0 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.684+0000 7f1102ffd640 10 monclient: get_auth_request con 0x7f10d0079fe0 auth_method 0 2026-02-25T15:00:49.690 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.685+0000 7f10e37fe640 10 client.4209.objecter ms_handle_connect 0x7f10d0079fe0 2026-02-25T15:00:49.691 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.688+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 656321336 0 0) 0x7f10ec05acc0 con 0x7f11041603a0 2026-02-25T15:00:49.691 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.688+0000 7f10e37fe640 10 client.4209.objecter ms_dispatch2 0x7f1104000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:00:49.691 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.688+0000 7f10e37fe640 3 client.4209.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:00:49.691 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.688+0000 7f10e37fe640 3 client.4209.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:00:49.691 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.688+0000 7f10e37fe640 20 client.4209.objecter dump_active .. 0 homeless 2026-02-25T15:00:49.775 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.773+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f1104161850 con 0x7f11041603a0 2026-02-25T15:00:49.775 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.773+0000 7f10e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:49.775 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.773+0000 7f10e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:49.886 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.884+0000 7f11094b9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:49.886 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.884+0000 7f11094b9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:49.886 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.884+0000 7f11094b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:49.886 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.884+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11041608f0 con 0x7f11041603a0 2026-02-25T15:00:49.906 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.904+0000 7f10e37fe640 1 -- 10.20.193.21:0/1266397500 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 302409104) 0x7f10ec029260 con 0x7f11041603a0 2026-02-25T15:00:49.906 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.904+0000 7f10e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:49.906 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.904+0000 7f10e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:49.906 INFO:teuthology.misc.health.trial021.stdout: 2026-02-25T15:00:49.906 INFO:teuthology.misc.health.trial021.stdout:{"epoch":18,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:00:39.668731+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 10 librados: watch_flush enter 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 10 librados: watch_flush exit 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 20 client.4209.objecter shutdown clearing up homeless session... 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 10 client.4209.objecter successfully canceled tick 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 >> v1:10.20.193.72:6800/2463505645 conn(0x7f10d0079fe0 legacy=0x7f10d009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 10 monclient: shutdown 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 >> v1:10.20.193.21:6789/0 conn(0x7f11041603a0 legacy=0x7f11040b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 shutdown_connections 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 >> 10.20.193.21:0/1266397500 conn(0x7f11040b65f0 msgr2=0x7f11041561a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 shutdown_connections 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.907+0000 7f11094b9640 1 -- 10.20.193.21:0/1266397500 wait complete. 2026-02-25T15:00:49.909 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:49.908+0000 7f11094b9640 1 librados: shutdown 2026-02-25T15:00:49.918 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:00:50.035 INFO:tasks.ceph.osd.0.trial021.stderr:--00:00:00:10.297 45466-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.039 INFO:tasks.ceph.osd.8.trial021.stderr:--00:00:00:10.294 45468-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.052 INFO:tasks.ceph.osd.13.trial031.stderr:--00:00:00:10.292 45060-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.057 INFO:tasks.ceph.osd.9.trial031.stderr:--00:00:00:10.300 45059-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.079 INFO:tasks.ceph.osd.12.trial021.stderr:--00:00:00:10.331 45470-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.082 INFO:tasks.ceph.osd.4.trial021.stderr:--00:00:00:10.340 45467-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.171 INFO:tasks.ceph.osd.15.trial072.stderr:--00:00:00:10.384 45714-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.173 INFO:tasks.ceph.osd.3.trial072.stderr:--00:00:00:10.389 45711-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.193 INFO:tasks.ceph.osd.10.trial068.stderr:--00:00:00:10.423 45198-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.203 INFO:tasks.ceph.osd.1.trial031.stderr:--00:00:00:10.452 45057-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.212 INFO:tasks.ceph.osd.14.trial068.stderr:--00:00:00:10.439 45199-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.225 INFO:tasks.ceph.osd.5.trial031.stderr:--00:00:00:10.470 45058-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.234 INFO:tasks.ceph.osd.7.trial072.stderr:--00:00:00:10.450 45712-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.236 INFO:tasks.ceph.osd.11.trial072.stderr:--00:00:00:10.452 45713-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.240 INFO:tasks.ceph.osd.6.trial068.stderr:--00:00:00:10.471 45197-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:50.367 INFO:tasks.ceph.osd.2.trial068.stderr:--00:00:00:10.603 45196-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/4f/df6491843300f77b7abd294d2e264b9099e4c0.debug 2026-02-25T15:00:52.125 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.380 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.138 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.400 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.193 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.448 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.201 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.443 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.204 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.444 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.205 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.467 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.229 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.480 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.229 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.484 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.232 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.489 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.244 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.506 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.263 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.518 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.265 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.508 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.273 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.514 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.283 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.545 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.287 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.518 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.290 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.542 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.292 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.505 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.295 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.511 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.295 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.551 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.299 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.557 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.305 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.548 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.310 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.559 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.314 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.555 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.315 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.577 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.323 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.550 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.324 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.576 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.328 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.585 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.330 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.585 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.334 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.577 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.345 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.600 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.347 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.609 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.352 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.597 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.353 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.594 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.361 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.575 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.362 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.593 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.362 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:12.624 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.363 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.615 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.368 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.626 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.368 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.611 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.369 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.585 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.371 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.620 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.377 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.617 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.377 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.609 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.387 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.603 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.387 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.638 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.388 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.615 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.395 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.608 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.396 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.627 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.396 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.654 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.400 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.616 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.401 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.649 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.403 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.646 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.408 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.624 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.412 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.653 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.413 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.640 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.418 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:12.661 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.420 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.651 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.420 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.672 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.420 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.665 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.421 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.669 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.425 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.638 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.427 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:12.668 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.435 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:12.686 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.439 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.655 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.440 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.667 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.443 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.701 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.444 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.675 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.445 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.658 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.448 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.679 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.455 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.671 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.458 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.703 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.458 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.694 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.461 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:12.718 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.463 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:00:52.459+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.467 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.716 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.467 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.694 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.468 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.683 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.471 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.702 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.472 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.687 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.473 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.687 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.480 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.696 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.482 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:00:52.478+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.488 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:12.702 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.490 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.735 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.491 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.722 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.492 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.709 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.495 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.744 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.497 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.724 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.498 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.714 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.506 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.722 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.507 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:12.738 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.509 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.740 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.510 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:12.759 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.512 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:12.739 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.514 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:12.730 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.515 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.760 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.526 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.742 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.527 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.763 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.528 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.759 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.535 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.751 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.538 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:00:52.534+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.539 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:00:52.534+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.540 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:00:52.538+0000 a75f640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2026-02-25T15:00:52.548 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:00:52.543+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.548 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.779 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.551 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.767 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.554 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.790 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.554 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.799 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.561 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.777 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.563 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:12.795 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.568 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:12.813 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.575 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:12.792 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.580 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.796 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.583 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:00:52.579+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.589 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.825 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.596 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:12.812 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.601 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:00:52.597+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.608 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:00:52.604+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.623 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:00:52.619+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.624 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.860 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.632 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:00:52.628+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.644 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:00:52.639+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.669 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.905 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.670 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:00:52.665+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.684 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:12.919 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.691 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:00:52.687+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.693 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:00:52.689+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.708 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:00:52.704+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.741 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:12.996 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.751 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.013 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.802 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:00:52.798+0000 787d4c0 -1 Falling back to public interface 2026-02-25T15:00:52.805 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.048 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.805 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.046 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.821 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.073 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.840 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.095 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.845 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.107 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.853 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.111 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.872 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.086 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.875 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.106 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.893 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.141 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.897 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.152 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.898 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.141 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.899 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.139 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.907 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.123 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.913 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.140 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.920 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.172 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.922 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.178 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.925 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.187 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.938 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.183 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.944 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.202 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.951 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.206 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.960 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.192 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.964 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.226 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.964 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.195 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.967 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.181 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.973 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.216 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.973 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.214 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.974 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.190 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.981 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.236 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.983 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.232 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.987 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.245 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.993 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.209 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:52.999 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.251 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.002 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.264 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.008 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.224 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.009 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.235 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.010 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.267 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.010 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.265 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.016 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.259 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.016 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.257 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.029 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.278 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.029 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.275 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.034 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.265 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.043 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.299 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.043 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.301 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.044 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.306 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.045 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.297 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.046 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.260 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.058 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.301 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.059 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.290 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.063 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.279 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.063 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.319 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.066 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.307 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.067 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.325 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.071 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.307 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.073 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.304 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.074 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.323 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.077 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.329 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.085 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.347 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.085 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.312 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.089 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.305 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.090 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.322 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.091 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.334 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.092 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.306 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.092 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.350 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.094 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.343 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.095 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.311 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.100 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.341 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.113 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.359 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.115 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.367 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.117 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.348 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.121 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.379 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.124 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.356 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.125 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.352 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.129 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.377 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.129 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.391 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.139 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.382 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.141 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.357 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.142 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.355 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.148 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.379 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.149 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.385 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.154 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.370 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.155 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.412 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.157 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.398 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.158 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.374 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.160 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.405 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.163 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.415 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.168 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.400 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.169 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.417 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.171 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.433 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.173 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.400 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.174 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.390 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.178 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.421 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.178 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.392 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.181 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.412 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.181 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.397 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.186 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.402 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.195 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.450 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.199 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.447 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.199 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.439 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.199 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.444 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.203 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.420 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.205 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.437 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.207 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.459 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.212 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.428 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.213 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.444 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.213 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.440 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.214 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.450 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.216 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.430 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.220 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.436 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.220 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.463 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.225 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.441 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.226 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.475 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.242 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.487 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.246 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.498 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.246 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.478 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.248 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.489 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.249 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.465 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.249 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.504 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.250 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.477 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.250 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.486 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.256 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.470 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.259 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.475 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.260 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.476 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.272 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.527 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.274 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.531 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.278 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.523 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.288 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.503 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.300 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.516 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.301 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.562 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.301 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.517 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.301 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.515 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.308 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.535 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.308 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.540 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.309 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.544 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.311 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.556 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.315 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.571 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.320 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:13.576 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.329 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.560 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.334 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.592 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.340 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.556 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.341 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.556 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.343 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.588 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.347 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.563 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.352 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.583 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.352 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.588 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.353 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.579 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.353 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.615 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.357 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.606 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.363 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.606 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.376 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.628 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.381 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.612 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.384 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.642 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.388 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.624 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.393 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.655 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.394 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.610 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.401 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.641 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.401 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.632 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.405 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.654 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.409 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.640 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.412 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.655 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.412 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.670 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.418 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:13.675 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.420 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.682 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.423 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.675 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.425 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.661 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.425 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:13.687 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.435 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.684 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.437 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.668 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.442 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:13.673 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.446 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.689 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.447 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.687 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.449 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.663 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.456 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.705 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.461 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:13.710 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.465 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.701 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.466 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.708 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.470 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.722 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.471 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:13.714 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.474 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.690 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.483 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.724 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.492 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.737 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.495 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.722 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.498 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.714 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.502 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.754 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.503 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.717 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.507 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:13.759 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.511 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.752 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.516 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:13.757 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.529 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.743 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.531 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.747 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.531 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.762 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.542 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.758 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.544 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.760 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.551 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.778 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.553 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.798 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.563 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.777 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.564 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.780 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.568 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:13.782 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.577 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.793 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.585 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.830 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.590 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.817 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.592 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.823 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.592 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.808 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.595 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.811 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.597 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:13.813 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.605 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.821 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.611 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:13.826 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.618 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.845 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.618 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.854 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.622 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.867 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.623 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:13.850 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.625 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.841 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.627 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.859 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.628 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:13.873 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.671 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.887 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.675 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.906 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.676 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:13.892 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.677 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.913 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.680 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:13.912 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.711 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.947 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.751 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.986 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:53.755 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:13.991 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.577 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:15.832 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.678 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:15.936 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.690 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:15.952 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.706 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:15.937 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.709 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:15.957 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.721 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:15.964 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.773 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:16.024 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.776 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:16.016 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.883 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:16.097 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.891 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:16.136 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.893 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:16.119 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.914 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:16.130 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.930 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:16.145 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.967 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:16.198 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:55.987 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:16.203 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:56.038 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:16.274 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.533 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.593+0000 7f1ddf246640 10 monclient: get_monmap_and_config 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.593+0000 7f1ddf246640 10 monclient: build_initial_monmap 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.593+0000 7f1ddf246640 10 monclient: monmap: 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T15:00:57.594373+0000 2026-02-25T15:00:57.595 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T15:00:57.594373+0000 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:57.596 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.598 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 1 Processor -- start 2026-02-25T15:00:57.598 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 1 -- start start 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient: init 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-c con 0x7f1dd8058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-a con 0x7f1dd80b0410 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-b con 0x7f1dd81626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd81655c0 con 0x7f1dd80b0410 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd80b12b0 con 0x7f1dd81626a0 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd80b1590 con 0x7f1dd8058da0 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.594+0000 7f1ddf246640 10 monclient(hunting): authenticate will time out at 3001.186669s 2026-02-25T15:00:57.599 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.595+0000 7f1dcffff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1dd80b0410 0x7f1dd8164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40344/0 (socket says 10.20.193.21:40344) 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.595+0000 7f1dcffff640 1 -- 10.20.193.21:0/3990562018 learned_addr learned my addr 10.20.193.21:0/3990562018 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687039256 0 0) 0x7f1dd81655c0 con 0x7f1dd80b0410 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): my global_id is 4260 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc4003610 con 0x7f1dd80b0410 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132834493 0 0) 0x7f1dd80b1590 con 0x7f1dd8058da0 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.600 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): my global_id is 4289 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd81655c0 con 0x7f1dd8058da0 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725774273 0 0) 0x7f1dd80b12b0 con 0x7f1dd81626a0 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 10 monclient(hunting): my global_id is 4279 2026-02-25T15:00:57.601 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.596+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd80b1590 con 0x7f1dd81626a0 2026-02-25T15:00:57.608 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1966994126 0 0) 0x7f1dc4003610 con 0x7f1dd80b0410 2026-02-25T15:00:57.608 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 >> v1:10.20.193.68:6789/0 conn(0x7f1dd8058da0 legacy=0x7f1dd81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 >> v1:10.20.193.31:6789/0 conn(0x7f1dd81626a0 legacy=0x7f1dd81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 monclient: found mon.noname-a 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd80b1870 con 0x7f1dd80b0410 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: _finish_auth 0 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1ddf246640 5 monclient: authenticate success, global_id 4260 2026-02-25T15:00:57.609 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1ddf246640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dc0002df0 con 0x7f1dd80b0410 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: dump: 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.610 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1ddf246640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1dc0002fc0 con 0x7f1dd80b0410 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 1 -- 10.20.193.21:0/3990562018 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dc0003400 con 0x7f1dd80b0410 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1ddf246640 10 monclient: get_monmap_and_config success 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1ddf246640 4 set_mon_vals no callback set 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:57.611 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.598+0000 7f1dcf7fe640 10 monclient: dump: 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 10 monclient: shutdown 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:57.612 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- 10.20.193.21:0/3990562018 >> v1:10.20.193.21:6789/0 conn(0x7f1dd80b0410 legacy=0x7f1dd8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- 10.20.193.21:0/3990562018 shutdown_connections 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- 10.20.193.21:0/3990562018 >> 10.20.193.21:0/3990562018 conn(0x7f1dd80b65f0 msgr2=0x7f1dd80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- 10.20.193.21:0/3990562018 shutdown_connections 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- 10.20.193.21:0/3990562018 wait complete. 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 10 monclient: build_initial_monmap 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 10 monclient: monmap: 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:last_changed 0.000000 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:created 0.000000 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:00:57.613 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 1 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 librados: starting msgr at 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 librados: starting objecter 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 Processor -- start 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 -- start start 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 librados: setting wanted keys 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 1 librados: calling monclient init 2026-02-25T15:00:57.614 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.599+0000 7f1ddf246640 10 monclient: init 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient: _reopen_session rank -1 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-b con 0x7f1dd8058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-c con 0x7f1dd80b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient(hunting): picked mon.noname-a con 0x7f1dd81626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd8136ac0 con 0x7f1dd81626a0 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd81634a0 con 0x7f1dd8058da0 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd8116120 con 0x7f1dd80b0410 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient(hunting): _renew_subs 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddf246640 10 monclient(hunting): authenticate will time out at 3001.192265s 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddd7bc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1dd81626a0 0x7f1dd8162d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40348/0 (socket says 10.20.193.21:40348) 2026-02-25T15:00:57.615 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1ddd7bc640 1 -- 10.20.193.21:0/2278297035 learned_addr learned my addr 10.20.193.21:0/2278297035 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1dcd7fa640 10 client.?.objecter ms_handle_connect 0x7f1dd81626a0 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1dcd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1dcd7fa640 10 client.?.objecter ms_handle_connect 0x7f1dd8058da0 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.600+0000 7f1dcd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 client.?.objecter ms_handle_connect 0x7f1dd80b0410 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406963187 0 0) 0x7f1dd8136ac0 con 0x7f1dd81626a0 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): my global_id is 4263 2026-02-25T15:00:57.616 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1da8003610 con 0x7f1dd81626a0 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394581400 0 0) 0x7f1dd81634a0 con 0x7f1dd8058da0 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 10 monclient(hunting): my global_id is 4282 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.601+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd8136ac0 con 0x7f1dd8058da0 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105059415 0 0) 0x7f1dd8116120 con 0x7f1dd80b0410 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 10 monclient(hunting): my global_id is 4292 2026-02-25T15:00:57.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.602+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd81634a0 con 0x7f1dd80b0410 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 756860552 0 0) 0x7f1da8003610 con 0x7f1dd81626a0 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dd8116120 con 0x7f1dd81626a0 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dd40033c0 con 0x7f1dd81626a0 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.618 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.603+0000 7f1dcd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184343191 0 0) 0x7f1dd8136ac0 con 0x7f1dd8058da0 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1da8003610 con 0x7f1dd8058da0 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dc80030b0 con 0x7f1dd8058da0 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.619 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3468666721 0 0) 0x7f1dd81634a0 con 0x7f1dd80b0410 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dd8136ac0 con 0x7f1dd80b0410 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dc0003310 con 0x7f1dd80b0410 2026-02-25T15:00:57.620 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.604+0000 7f1dcd7fa640 10 monclient(hunting): dump: 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.621 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1452450471 0 0) 0x7f1dd8116120 con 0x7f1dd81626a0 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 >> v1:10.20.193.68:6789/0 conn(0x7f1dd80b0410 legacy=0x7f1dd8117240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 >> v1:10.20.193.31:6789/0 conn(0x7f1dd8058da0 legacy=0x7f1dd8115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 1 monclient: found mon.a 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd8116400 con 0x7f1dd81626a0 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 10 monclient: _finish_auth 0 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1dcd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 5 monclient: authenticate success, global_id 4263 2026-02-25T15:00:57.622 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 10 monclient: _renew_subs 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd81166e0 con 0x7f1dd81626a0 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 10 client.4263.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 10 monclient: _renew_subs 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1dd814bb80 con 0x7f1dd81626a0 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.605+0000 7f1ddf246640 1 librados: init done 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.606+0000 7f1ddf246640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.606+0000 7f1ddf246640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.606+0000 7f1ddf246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.623 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.606+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd8116920 con 0x7f1dd81626a0 2026-02-25T15:00:57.701 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1dd4003a80 con 0x7f1dd81626a0 2026-02-25T15:00:57.701 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:00:57.701 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1dd4003e50 con 0x7f1dd81626a0 2026-02-25T15:00:57.701 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:00:57.701 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dcd7fa640 10 monclient: dump: 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:00:57.702 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.699+0000 7f1dceffd640 4 set_mon_vals no callback set 2026-02-25T15:00:57.703 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.700+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7f1dd4004030 con 0x7f1dd81626a0 2026-02-25T15:00:57.703 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.700+0000 7f1ddcfbb640 10 monclient: get_auth_request con 0x7f1da807a000 auth_method 0 2026-02-25T15:00:57.704 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.701+0000 7f1dcd7fa640 10 client.4263.objecter ms_handle_connect 0x7f1da807a000 2026-02-25T15:00:57.705 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.703+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 656321336 0 0) 0x7f1dd405af40 con 0x7f1dd81626a0 2026-02-25T15:00:57.705 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.703+0000 7f1dcd7fa640 10 client.4263.objecter ms_dispatch2 0x7f1dd8000b90 osd_map(18..18 src has 1..18) 2026-02-25T15:00:57.705 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.703+0000 7f1dcd7fa640 3 client.4263.objecter handle_osd_map got epochs [18,18] > 0 2026-02-25T15:00:57.706 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.703+0000 7f1dcd7fa640 3 client.4263.objecter handle_osd_map decoding full epoch 18 2026-02-25T15:00:57.706 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.703+0000 7f1dcd7fa640 20 client.4263.objecter dump_active .. 0 homeless 2026-02-25T15:00:57.706 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.704+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f1dd405f6b0 con 0x7f1dd81626a0 2026-02-25T15:00:57.706 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.704+0000 7f1dcd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:00:57.706 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.704+0000 7f1dcd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:00:57.809 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:18.064 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.818 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.817+0000 7f1ddf246640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:57.818 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.817+0000 7f1ddf246640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:57.819 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.817+0000 7f1ddf246640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:00:57.819 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.817+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dd8163990 con 0x7f1dd81626a0 2026-02-25T15:00:57.826 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.824+0000 7f1dcd7fa640 1 -- 10.20.193.21:0/2278297035 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 302409104) 0x7f1dd4003e50 con 0x7f1dd81626a0 2026-02-25T15:00:57.826 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.824+0000 7f1dcd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:00:57.826 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.824+0000 7f1dcd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:00:57.826 INFO:teuthology.misc.health.trial021.stdout: 2026-02-25T15:00:57.827 INFO:teuthology.misc.health.trial021.stdout:{"epoch":18,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:00:39.668731+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:00:57.829 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 10 librados: watch_flush enter 2026-02-25T15:00:57.829 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 10 librados: watch_flush exit 2026-02-25T15:00:57.829 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 20 client.4263.objecter shutdown clearing up homeless session... 2026-02-25T15:00:57.829 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 10 client.4263.objecter successfully canceled tick 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 >> v1:10.20.193.72:6800/2463505645 conn(0x7f1da807a000 legacy=0x7f1da809a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 10 monclient: shutdown 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 >> v1:10.20.193.21:6789/0 conn(0x7f1dd81626a0 legacy=0x7f1dd8162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 shutdown_connections 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 >> 10.20.193.21:0/2278297035 conn(0x7f1dd80b65f0 msgr2=0x7f1dd805dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 shutdown_connections 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 -- 10.20.193.21:0/2278297035 wait complete. 2026-02-25T15:00:57.830 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:00:57.827+0000 7f1ddf246640 1 librados: shutdown 2026-02-25T15:00:57.835 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:18.091 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.836 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-25T15:00:57.838 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:18.093 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.898 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:18.160 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.907 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:18.150 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.914 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:18.172 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.919 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:18.168 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.925 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:18.187 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.927 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:18.169 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.928 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:18.190 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.930 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:18.172 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.932 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:18.163 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.945 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:18.202 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.948 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:18.205 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.957 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:18.205 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.960 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:18.208 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.960 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:18.212 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.969 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:18.200 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.972 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:18.203 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.989 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:18.240 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:57.992 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:18.243 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.012 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:18.252 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.045 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:18.285 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.047 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:18.288 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.067 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:18.312 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.106 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:18.351 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.108 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:18.353 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.115 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:18.342 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.151 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:18.378 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.154 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:18.380 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.154 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:18.368 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.177 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:18.409 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.180 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:18.394 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.182 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:18.398 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.183 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:18.397 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.186 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:18.401 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.212 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:18.443 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.215 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:18.446 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.215 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:18.431 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.218 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:18.434 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.218 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:18.434 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.221 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:18.437 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.263 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:18.499 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.267 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:18.483 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.289 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:18.505 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.292 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:18.508 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.302 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:18.537 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:58.305 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:18.541 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.437 INFO:tasks.ceph.osd.8.trial021.stderr:==00:00:00:19.692 45468== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.504 INFO:tasks.ceph.osd.0.trial021.stderr:==00:00:00:19.766 45466== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.524 INFO:tasks.ceph.osd.9.trial031.stderr:==00:00:00:19.767 45059== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.544 INFO:tasks.ceph.osd.1.trial031.stderr:==00:00:00:19.792 45057== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.545 INFO:tasks.ceph.osd.4.trial021.stderr:==00:00:00:19.803 45467== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.558 INFO:tasks.ceph.osd.10.trial068.stderr:==00:00:00:19.789 45198== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.572 INFO:tasks.ceph.osd.12.trial021.stderr:==00:00:00:19.824 45470== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.649 INFO:tasks.ceph.osd.13.trial031.stderr:==00:00:00:19.890 45060== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.714 INFO:tasks.ceph.osd.5.trial031.stderr:==00:00:00:19.959 45058== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.750 INFO:tasks.ceph.osd.14.trial068.stderr:==00:00:00:19.976 45199== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.801 INFO:tasks.ceph.osd.15.trial072.stderr:==00:00:00:20.015 45714== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.822 INFO:tasks.ceph.osd.6.trial068.stderr:==00:00:00:20.054 45197== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.846 INFO:tasks.ceph.osd.7.trial072.stderr:==00:00:00:20.062 45712== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.862 INFO:tasks.ceph.osd.3.trial072.stderr:==00:00:00:20.077 45711== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.906 INFO:tasks.ceph.osd.2.trial068.stderr:==00:00:00:20.142 45196== Warning: unimplemented fcntl command: 1038 2026-02-25T15:00:59.929 INFO:tasks.ceph.osd.11.trial072.stderr:==00:00:00:20.145 45713== Warning: unimplemented fcntl command: 1038 2026-02-25T15:01:02.199 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:01:02.196+0000 787d4c0 -1 osd.8 0 log_to_monitors true 2026-02-25T15:01:02.241 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:01:02.237+0000 787d4c0 -1 osd.9 0 log_to_monitors true 2026-02-25T15:01:02.252 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:01:02.249+0000 787d4c0 -1 osd.0 0 log_to_monitors true 2026-02-25T15:01:02.278 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:01:02.275+0000 787d4c0 -1 osd.4 0 log_to_monitors true 2026-02-25T15:01:02.296 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:01:02.293+0000 787d4c0 -1 osd.1 0 log_to_monitors true 2026-02-25T15:01:02.343 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:01:02.340+0000 787d4c0 -1 osd.10 0 log_to_monitors true 2026-02-25T15:01:02.354 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:01:02.350+0000 787d4c0 -1 osd.12 0 log_to_monitors true 2026-02-25T15:01:02.380 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:01:02.377+0000 787d4c0 -1 osd.13 0 log_to_monitors true 2026-02-25T15:01:02.457 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:01:02.454+0000 787d4c0 -1 osd.5 0 log_to_monitors true 2026-02-25T15:01:02.520 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:01:02.517+0000 787d4c0 -1 osd.14 0 log_to_monitors true 2026-02-25T15:01:02.586 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:01:02.583+0000 787d4c0 -1 osd.6 0 log_to_monitors true 2026-02-25T15:01:02.624 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:01:02.620+0000 787d4c0 -1 osd.15 0 log_to_monitors true 2026-02-25T15:01:02.659 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:01:02.656+0000 787d4c0 -1 osd.2 0 log_to_monitors true 2026-02-25T15:01:02.686 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:01:02.683+0000 787d4c0 -1 osd.7 0 log_to_monitors true 2026-02-25T15:01:02.689 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:01:02.686+0000 787d4c0 -1 osd.3 0 log_to_monitors true 2026-02-25T15:01:02.749 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:01:02.746+0000 787d4c0 -1 osd.11 0 log_to_monitors true 2026-02-25T15:01:04.060 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:01:04.056+0000 df77640 -1 osd.4 0 waiting for initial osdmap 2026-02-25T15:01:04.103 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:01:04.100+0000 df77640 -1 osd.8 0 waiting for initial osdmap 2026-02-25T15:01:04.111 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:01:04.109+0000 cf64640 -1 osd.1 0 waiting for initial osdmap 2026-02-25T15:01:04.112 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:01:04.111+0000 df77640 -1 osd.0 0 waiting for initial osdmap 2026-02-25T15:01:04.128 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:01:04.124+0000 cf64640 -1 osd.9 0 waiting for initial osdmap 2026-02-25T15:01:04.268 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:01:04.260+0000 1255f640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:04.319 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:01:04.311+0000 1255f640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:04.320 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:01:04.313+0000 16567640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:04.328 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:01:04.321+0000 1255f640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:04.340 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:01:04.333+0000 16567640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.149 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:01:05.145+0000 df77640 -1 osd.6 0 waiting for initial osdmap 2026-02-25T15:01:05.160 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:01:05.157+0000 df77640 -1 osd.10 0 waiting for initial osdmap 2026-02-25T15:01:05.179 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:01:05.175+0000 cf64640 -1 osd.13 0 waiting for initial osdmap 2026-02-25T15:01:05.183 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:01:05.181+0000 cf64640 -1 osd.15 0 waiting for initial osdmap 2026-02-25T15:01:05.188 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:01:05.185+0000 df77640 -1 osd.7 0 waiting for initial osdmap 2026-02-25T15:01:05.189 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:01:05.186+0000 cf64640 -1 osd.12 0 waiting for initial osdmap 2026-02-25T15:01:05.195 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:01:05.192+0000 cf64640 -1 osd.5 0 waiting for initial osdmap 2026-02-25T15:01:05.203 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:01:05.200+0000 df77640 -1 osd.3 0 waiting for initial osdmap 2026-02-25T15:01:05.210 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:01:05.207+0000 df77640 -1 osd.14 0 waiting for initial osdmap 2026-02-25T15:01:05.213 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:01:05.209+0000 df77640 -1 osd.11 0 waiting for initial osdmap 2026-02-25T15:01:05.250 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:01:05.247+0000 cf64640 -1 osd.2 0 waiting for initial osdmap 2026-02-25T15:01:05.373 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:01:05.365+0000 16967640 -1 osd.6 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.393 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:01:05.385+0000 1255f640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.408 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:01:05.400+0000 16567640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.411 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:01:05.403+0000 1255f640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.413 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:01:05.405+0000 16567640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.415 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:01:05.408+0000 16967640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.419 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:01:05.412+0000 16567640 -1 osd.12 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.425 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:01:05.417+0000 16567640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.434 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:01:05.426+0000 16567640 -1 osd.14 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.448 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:01:05.460 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:01:05.453+0000 16967640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.472 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:01:05.464+0000 16967640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T15:01:05.509 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 10 monclient: get_monmap_and_config 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 10 monclient: build_initial_monmap 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 10 monclient: monmap: 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T15:01:05.509110+0000 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T15:01:05.509110+0000 2026-02-25T15:01:05.510 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:05.511 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.511 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:05.511 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:05.511 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:05.511 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 1 Processor -- start 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 1 -- start start 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.508+0000 7fea7ef55640 10 monclient: init 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:05.514 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-c con 0x7fea78058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-a con 0x7fea78059170 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-b con 0x7fea78159ee0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea7805d6e0 con 0x7fea78059170 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea78164100 con 0x7fea78159ee0 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea780a8ff0 con 0x7fea78058da0 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7ef55640 10 monclient(hunting): authenticate will time out at 3009.101471s 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7d4cb640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fea78159ee0 0x7fea78163340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:56754/0 (socket says 10.20.193.21:56754) 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.509+0000 7fea7d4cb640 1 -- 10.20.193.21:0/2222870676 learned_addr learned my addr 10.20.193.21:0/2222870676 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:05.515 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996675372 0 0) 0x7fea78164100 con 0x7fea78159ee0 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): my global_id is 4330 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea64003610 con 0x7fea78159ee0 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991005466 0 0) 0x7fea7805d6e0 con 0x7fea78059170 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 10 monclient(hunting): my global_id is 4314 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea78164100 con 0x7fea78059170 2026-02-25T15:01:05.516 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.511+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965971181 0 0) 0x7fea780a8ff0 con 0x7fea78058da0 2026-02-25T15:01:05.517 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.512+0000 7fea6f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.517 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.512+0000 7fea6f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.517 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.512+0000 7fea6f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.517 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.512+0000 7fea6f7fe640 10 monclient(hunting): my global_id is 4343 2026-02-25T15:01:05.517 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.512+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea7805d6e0 con 0x7fea78058da0 2026-02-25T15:01:05.524 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1154822694 0 0) 0x7fea64003610 con 0x7fea78159ee0 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 >> v1:10.20.193.68:6789/0 conn(0x7fea78058da0 legacy=0x7fea7805cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 >> v1:10.20.193.21:6789/0 conn(0x7fea78059170 legacy=0x7fea781597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 monclient: found mon.noname-b 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea780a92d0 con 0x7fea78159ee0 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:05.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea74003170 con 0x7fea78159ee0 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea6f7fe640 10 monclient: dump: 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.526 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea7ef55640 5 monclient: authenticate success, global_id 4330 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.513+0000 7fea7ef55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea74003340 con 0x7fea78159ee0 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 1 -- 10.20.193.21:0/2222870676 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea74003780 con 0x7fea78159ee0 2026-02-25T15:01:05.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea6f7fe640 10 monclient: dump: 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.528 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 4 set_mon_vals no callback set 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 10 monclient: shutdown 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- 10.20.193.21:0/2222870676 >> v1:10.20.193.31:6789/0 conn(0x7fea78159ee0 legacy=0x7fea78163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- 10.20.193.21:0/2222870676 shutdown_connections 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- 10.20.193.21:0/2222870676 >> 10.20.193.21:0/2222870676 conn(0x7fea780b65f0 msgr2=0x7fea780b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:05.529 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- 10.20.193.21:0/2222870676 shutdown_connections 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- 10.20.193.21:0/2222870676 wait complete. 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 10 monclient: build_initial_monmap 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 10 monclient: monmap: 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:created 0.000000 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 1 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:05.530 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 librados: starting msgr at 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 librados: starting objecter 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 Processor -- start 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 -- start start 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 librados: setting wanted keys 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 1 librados: calling monclient init 2026-02-25T15:01:05.531 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.514+0000 7fea7ef55640 10 monclient: init 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-b con 0x7fea78058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-a con 0x7fea78059170 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient(hunting): picked mon.noname-c con 0x7fea78159ee0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea78162a00 con 0x7fea78059170 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea78162ce0 con 0x7fea78058da0 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea78162fc0 con 0x7fea78159ee0 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:05.532 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea7ef55640 10 monclient(hunting): authenticate will time out at 3009.107355s 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea6ffff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fea78059170 0x7fea7811e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:54698/0 (socket says 10.20.193.21:54698) 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea6ffff640 1 -- 10.20.193.21:0/3920576444 learned_addr learned my addr 10.20.193.21:0/3920576444 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea6d7fa640 10 client.?.objecter ms_handle_connect 0x7fea78059170 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.515+0000 7fea6d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 client.?.objecter ms_handle_connect 0x7fea78159ee0 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 client.?.objecter ms_handle_connect 0x7fea78058da0 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940991370 0 0) 0x7fea78162a00 con 0x7fea78059170 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.533 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 10 monclient(hunting): my global_id is 4317 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.516+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea48003610 con 0x7fea78059170 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188121768 0 0) 0x7fea78162ce0 con 0x7fea78058da0 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): my global_id is 4333 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea78162a00 con 0x7fea78058da0 2026-02-25T15:01:05.534 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526491074 0 0) 0x7fea78162fc0 con 0x7fea78159ee0 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 10 monclient(hunting): my global_id is 4346 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.517+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea78162ce0 con 0x7fea78159ee0 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4099627843 0 0) 0x7fea48003610 con 0x7fea78059170 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea78162fc0 con 0x7fea78059170 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 29695013 0 0) 0x7fea78162a00 con 0x7fea78058da0 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea48003610 con 0x7fea78058da0 2026-02-25T15:01:05.535 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea68002fe0 con 0x7fea78058da0 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.536 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea600032d0 con 0x7fea78059170 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.519+0000 7fea6d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.537 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 155003569 0 0) 0x7fea78162ce0 con 0x7fea78159ee0 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea78162a00 con 0x7fea78159ee0 2026-02-25T15:01:05.538 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea74003690 con 0x7fea78159ee0 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.520+0000 7fea6d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.539 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1714893768 0 0) 0x7fea48003610 con 0x7fea78058da0 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 >> v1:10.20.193.68:6789/0 conn(0x7fea78159ee0 legacy=0x7fea7811ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 >> v1:10.20.193.21:6789/0 conn(0x7fea78059170 legacy=0x7fea7811e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 1 monclient: found mon.b 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.540 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea781632a0 con 0x7fea78058da0 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea6d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 5 monclient: authenticate success, global_id 4333 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _renew_subs 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea7811c4d0 con 0x7fea78058da0 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 client.4333.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _renew_subs 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.541 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea781624c0 con 0x7fea78058da0 2026-02-25T15:01:05.542 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 1 librados: init done 2026-02-25T15:01:05.542 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:05.542 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:05.542 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.542 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.521+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea78162740 con 0x7fea78058da0 2026-02-25T15:01:05.543 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea68003700 con 0x7fea78058da0 2026-02-25T15:01:05.543 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:05.543 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fea68003a50 con 0x7fea78058da0 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6d7fa640 10 monclient: dump: 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:05.544 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.529+0000 7fea6effd640 4 set_mon_vals no callback set 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 2072221081 0 0) 0x7fea6801cf00 con 0x7fea78058da0 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6ffff640 10 monclient: get_auth_request con 0x7fea48079ff0 auth_method 0 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 10 client.4333.objecter ms_handle_connect 0x7fea48079ff0 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 5828+0+0 (unknown 4257284897 0 0) 0x7fea680599c0 con 0x7fea78058da0 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 10 client.4333.objecter ms_dispatch2 0x7fea78000b90 osd_map(21..21 src has 1..21) 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 3 client.4333.objecter handle_osd_map got epochs [21,21] > 0 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.530+0000 7fea6d7fa640 3 client.4333.objecter handle_osd_map decoding full epoch 21 2026-02-25T15:01:05.545 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.531+0000 7fea6d7fa640 20 client.4333.objecter dump_active .. 0 homeless 2026-02-25T15:01:05.617 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.616+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fea6805e130 con 0x7fea78058da0 2026-02-25T15:01:05.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.616+0000 7fea6d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:05.618 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.616+0000 7fea6d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:05.722 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.720+0000 7fea7ef55640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:05.722 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.720+0000 7fea7ef55640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:05.722 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.720+0000 7fea7ef55640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:05.722 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.720+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea78138890 con 0x7fea78058da0 2026-02-25T15:01:05.730 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.729+0000 7fea6d7fa640 1 -- 10.20.193.21:0/3920576444 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+14070 (unknown 898900276 0 3508540322) 0x7fea6805da30 con 0x7fea78058da0 2026-02-25T15:01:05.731 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.729+0000 7fea6d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:05.731 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.729+0000 7fea6d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:05.731 INFO:teuthology.misc.health.trial021.stdout: 2026-02-25T15:01:05.732 INFO:teuthology.misc.health.trial021.stdout:{"epoch":21,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:01:04.925819+0000","last_up_change":"2026-02-25T15:01:04.925819+0000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6804","nonce":2253484549}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6805","nonce":2253484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6807","nonce":2253484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6806","nonce":2253484549}]},"public_addr":"10.20.193.21:6804/2253484549","cluster_addr":"10.20.193.21:6805/2253484549","heartbeat_back_addr":"10.20.193.21:6807/2253484549","heartbeat_front_addr":"10.20.193.21:6806/2253484549","state":["exists","up"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6808","nonce":1809978267}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6809","nonce":1809978267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6811","nonce":1809978267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6810","nonce":1809978267}]},"public_addr":"10.20.193.31:6808/1809978267","cluster_addr":"10.20.193.31:6809/1809978267","heartbeat_back_addr":"10.20.193.31:6811/1809978267","heartbeat_front_addr":"10.20.193.31:6810/1809978267","state":["exists","up"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6812","nonce":2726560095}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6813","nonce":2726560095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6815","nonce":2726560095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6814","nonce":2726560095}]},"public_addr":"10.20.193.21:6812/2726560095","cluster_addr":"10.20.193.21:6813/2726560095","heartbeat_back_addr":"10.20.193.21:6815/2726560095","heartbeat_front_addr":"10.20.193.21:6814/2726560095","state":["exists","up"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6800","nonce":3085828309}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6801","nonce":3085828309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6803","nonce":3085828309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6802","nonce":3085828309}]},"public_addr":"10.20.193.21:6800/3085828309","cluster_addr":"10.20.193.21:6801/3085828309","heartbeat_back_addr":"10.20.193.21:6803/3085828309","heartbeat_front_addr":"10.20.193.21:6802/3085828309","state":["exists","up"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6800","nonce":3462355980}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6802","nonce":3462355980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6805","nonce":3462355980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6803","nonce":3462355980}]},"public_addr":"10.20.193.31:6800/3462355980","cluster_addr":"10.20.193.31:6802/3462355980","heartbeat_back_addr":"10.20.193.31:6805/3462355980","heartbeat_front_addr":"10.20.193.31:6803/3462355980","state":["exists","up"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 10 librados: watch_flush enter 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 10 librados: watch_flush exit 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 20 client.4333.objecter shutdown clearing up homeless session... 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 10 client.4333.objecter successfully canceled tick 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 >> v1:10.20.193.72:6800/2463505645 conn(0x7fea48079ff0 legacy=0x7fea4809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 10 monclient: shutdown 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:05.733 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 >> v1:10.20.193.31:6789/0 conn(0x7fea78058da0 legacy=0x7fea7811dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:05.734 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 shutdown_connections 2026-02-25T15:01:05.734 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 >> 10.20.193.21:0/3920576444 conn(0x7fea780b65f0 msgr2=0x7fea781542d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:05.734 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 shutdown_connections 2026-02-25T15:01:05.734 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 -- 10.20.193.21:0/3920576444 wait complete. 2026-02-25T15:01:05.734 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:05.730+0000 7fea7ef55640 1 librados: shutdown 2026-02-25T15:01:05.740 DEBUG:teuthology.misc:5 of 16 OSDs are up 2026-02-25T15:01:13.353 DEBUG:teuthology.orchestra.run.trial021:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.413+0000 7fa20949c640 10 monclient: get_monmap_and_config 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.413+0000 7fa20949c640 10 monclient: build_initial_monmap 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.413+0000 7fa20949c640 10 monclient: monmap: 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.415 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T15:01:13.414340+0000 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T15:01:13.414340+0000 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:13.416 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.418 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 1 Processor -- start 2026-02-25T15:01:13.418 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 1 -- start start 2026-02-25T15:01:13.418 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient: init 2026-02-25T15:01:13.418 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:13.418 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-a con 0x7fa204058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-c con 0x7fa2040b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-b con 0x7fa2041626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2041655c0 con 0x7fa204058da0 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040b12b0 con 0x7fa2041626a0 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2040b1590 con 0x7fa2040b0410 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.414+0000 7fa20949c640 10 monclient(hunting): authenticate will time out at 3017.006650s 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.415+0000 7fa2037fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fa2041626a0 0x7fa2041c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:45824/0 (socket says 10.20.193.21:45824) 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.415+0000 7fa2037fe640 1 -- 10.20.193.21:0/56445515 learned_addr learned my addr 10.20.193.21:0/56445515 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080357376 0 0) 0x7fa2040b1590 con 0x7fa2040b0410 2026-02-25T15:01:13.419 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): my global_id is 4355 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003610 con 0x7fa2040b0410 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872368588 0 0) 0x7fa2040b12b0 con 0x7fa2041626a0 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 10 monclient(hunting): my global_id is 4342 2026-02-25T15:01:13.420 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.416+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2040b1590 con 0x7fa2041626a0 2026-02-25T15:01:13.425 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1434971983 0 0) 0x7fa2040b1590 con 0x7fa2041626a0 2026-02-25T15:01:13.425 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 >> v1:10.20.193.68:6789/0 conn(0x7fa2040b0410 legacy=0x7fa204164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.425 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 >> v1:10.20.193.21:6789/0 conn(0x7fa204058da0 legacy=0x7fa2041647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:13.425 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 monclient: found mon.noname-b 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040b1870 con 0x7fa2041626a0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1f4003170 con 0x7fa2041626a0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:13.426 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa201ffb640 10 monclient: dump: 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa20949c640 5 monclient: authenticate success, global_id 4342 2026-02-25T15:01:13.427 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.418+0000 7fa20949c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1f40033c0 con 0x7fa2041626a0 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 1 -- 10.20.193.21:0/56445515 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1f4003800 con 0x7fa2041626a0 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa201ffb640 10 monclient: dump: 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.428 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa20949c640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa20949c640 4 set_mon_vals no callback set 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa20949c640 10 monclient: shutdown 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa20949c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:13.429 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.419+0000 7fa20949c640 1 -- 10.20.193.21:0/56445515 >> v1:10.20.193.31:6789/0 conn(0x7fa2041626a0 legacy=0x7fa2041c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 -- 10.20.193.21:0/56445515 shutdown_connections 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 -- 10.20.193.21:0/56445515 >> 10.20.193.21:0/56445515 conn(0x7fa2040b65f0 msgr2=0x7fa2040b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 -- 10.20.193.21:0/56445515 shutdown_connections 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 -- 10.20.193.21:0/56445515 wait complete. 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 10 monclient: build_initial_monmap 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 10 monclient: monmap: 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:epoch 0 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:created 0.000000 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:13.430 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 1 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 librados: starting msgr at 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 librados: starting objecter 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 Processor -- start 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 -- start start 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 librados: setting wanted keys 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 1 librados: calling monclient init 2026-02-25T15:01:13.431 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.420+0000 7fa20949c640 10 monclient: init 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-b con 0x7fa204058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-a con 0x7fa2040b0410 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient(hunting): picked mon.noname-c con 0x7fa2041626a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20413b380 con 0x7fa2040b0410 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20413b660 con 0x7fa204058da0 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20413b940 con 0x7fa2041626a0 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa20949c640 10 monclient(hunting): authenticate will time out at 3017.013206s 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa2037fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa2041626a0 0x7fa204164430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39300/0 (socket says 10.20.193.21:39300) 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa2037fe640 1 -- 10.20.193.21:0/3345972631 learned_addr learned my addr 10.20.193.21:0/3345972631 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:13.432 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa1e37fe640 10 client.?.objecter ms_handle_connect 0x7fa2041626a0 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.421+0000 7fa1e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 client.?.objecter ms_handle_connect 0x7fa204058da0 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594930229 0 0) 0x7fa20413b940 con 0x7fa2041626a0 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 10 monclient(hunting): my global_id is 4358 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.422+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d0003610 con 0x7fa2041626a0 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 client.?.objecter ms_handle_connect 0x7fa2040b0410 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.433 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065614723 0 0) 0x7fa20413b660 con 0x7fa204058da0 2026-02-25T15:01:13.434 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.434 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.434 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.434 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 10 monclient(hunting): my global_id is 4345 2026-02-25T15:01:13.434 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.423+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20413b940 con 0x7fa204058da0 2026-02-25T15:01:13.437 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 410823192 0 0) 0x7fa1d0003610 con 0x7fa2041626a0 2026-02-25T15:01:13.437 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa20413b660 con 0x7fa2041626a0 2026-02-25T15:01:13.437 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1f4003830 con 0x7fa2041626a0 2026-02-25T15:01:13.437 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:13.437 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.438 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.426+0000 7fa1e37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749474533 0 0) 0x7fa20413b380 con 0x7fa2040b0410 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 10 monclient(hunting): my global_id is 4329 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.427+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d0003610 con 0x7fa2040b0410 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 329511080 0 0) 0x7fa20413b940 con 0x7fa204058da0 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa20413b380 con 0x7fa204058da0 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1f8002f70 con 0x7fa204058da0 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:13.439 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.428+0000 7fa1e37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.440 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 56236580 0 0) 0x7fa20413b660 con 0x7fa2041626a0 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 >> v1:10.20.193.31:6789/0 conn(0x7fa204058da0 legacy=0x7fa20413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 >> v1:10.20.193.21:6789/0 conn(0x7fa2040b0410 legacy=0x7fa20413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 1 monclient: found mon.c 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20413bc20 con 0x7fa2041626a0 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:13.441 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa1e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 5 monclient: authenticate success, global_id 4358 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _renew_subs 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa20413f130 con 0x7fa2041626a0 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 client.4358.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _renew_subs 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa20413d7a0 con 0x7fa2041626a0 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 1 librados: init done 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.442 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.443 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.429+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20413ca00 con 0x7fa2041626a0 2026-02-25T15:01:13.518 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.516+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1f4003380 con 0x7fa2041626a0 2026-02-25T15:01:13.518 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.516+0000 7fa1e37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:13.518 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.516+0000 7fa2017fa640 4 set_mon_vals no callback set 2026-02-25T15:01:13.523 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.522+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1f40050a0 con 0x7fa2041626a0 2026-02-25T15:01:13.523 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.522+0000 7fa1e37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.523 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.522+0000 7fa1e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:13.523 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.522+0000 7fa1e37fe640 10 monclient: dump: 2026-02-25T15:01:13.523 INFO:teuthology.misc.health.trial021.stderr:epoch 1 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.524 INFO:teuthology.misc.health.trial021.stderr: 2026-02-25T15:01:13.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.522+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fa1f401e580 con 0x7fa2041626a0 2026-02-25T15:01:13.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.523+0000 7fa202ffd640 10 monclient: get_auth_request con 0x7fa1d0079ee0 auth_method 0 2026-02-25T15:01:13.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.523+0000 7fa1e37fe640 10 client.4358.objecter ms_handle_connect 0x7fa1d0079ee0 2026-02-25T15:01:13.525 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.524+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 2696637847 0 0) 0x7fa1f405b2c0 con 0x7fa2041626a0 2026-02-25T15:01:13.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.524+0000 7fa1e37fe640 10 client.4358.objecter ms_dispatch2 0x7fa204000b90 osd_map(25..25 src has 1..25) 2026-02-25T15:01:13.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.524+0000 7fa1e37fe640 3 client.4358.objecter handle_osd_map got epochs [25,25] > 0 2026-02-25T15:01:13.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.524+0000 7fa1e37fe640 3 client.4358.objecter handle_osd_map decoding full epoch 25 2026-02-25T15:01:13.526 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.524+0000 7fa1e37fe640 20 client.4358.objecter dump_active .. 0 homeless 2026-02-25T15:01:13.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.525+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fa1f405fa30 con 0x7fa2041626a0 2026-02-25T15:01:13.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.525+0000 7fa1e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.527 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.525+0000 7fa1e37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:13.634 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.632+0000 7fa20949c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:13.634 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.632+0000 7fa20949c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:13.634 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.632+0000 7fa20949c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.634 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.632+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa20405e060 con 0x7fa2041626a0 2026-02-25T15:01:13.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.671+0000 7fa1e37fe640 1 -- 10.20.193.21:0/3345972631 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18861 (unknown 780366164 0 39598156) 0x7fa1f405f330 con 0x7fa2041626a0 2026-02-25T15:01:13.673 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.671+0000 7fa1e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:13.674 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.671+0000 7fa1e37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:13.674 INFO:teuthology.misc.health.trial021.stdout: 2026-02-25T15:01:13.674 INFO:teuthology.misc.health.trial021.stdout:{"epoch":25,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:01:09.264993+0000","last_up_change":"2026-02-25T15:01:06.008609+0000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:01:05.912164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6804","nonce":2253484549}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6805","nonce":2253484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6807","nonce":2253484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6806","nonce":2253484549}]},"public_addr":"10.20.193.21:6804/2253484549","cluster_addr":"10.20.193.21:6805/2253484549","heartbeat_back_addr":"10.20.193.21:6807/2253484549","heartbeat_front_addr":"10.20.193.21:6806/2253484549","state":["exists","up"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6808","nonce":1809978267}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6809","nonce":1809978267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6811","nonce":1809978267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6810","nonce":1809978267}]},"public_addr":"10.20.193.31:6808/1809978267","cluster_addr":"10.20.193.31:6809/1809978267","heartbeat_back_addr":"10.20.193.31:6811/1809978267","heartbeat_front_addr":"10.20.193.31:6810/1809978267","state":["exists","up"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":3838375510}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":3838375510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":3838375510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":3838375510}]},"public_addr":"10.20.193.68:6812/3838375510","cluster_addr":"10.20.193.68:6813/3838375510","heartbeat_back_addr":"10.20.193.68:6815/3838375510","heartbeat_front_addr":"10.20.193.68:6814/3838375510","state":["exists","up"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6805","nonce":464837367}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6806","nonce":464837367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6808","nonce":464837367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6807","nonce":464837367}]},"public_addr":"10.20.193.72:6805/464837367","cluster_addr":"10.20.193.72:6806/464837367","heartbeat_back_addr":"10.20.193.72:6808/464837367","heartbeat_front_addr":"10.20.193.72:6807/464837367","state":["exists","up"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6812","nonce":2726560095}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6813","nonce":2726560095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6815","nonce":2726560095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6814","nonce":2726560095}]},"public_addr":"10.20.193.21:6812/2726560095","cluster_addr":"10.20.193.21:6813/2726560095","heartbeat_back_addr":"10.20.193.21:6815/2726560095","heartbeat_front_addr":"10.20.193.21:6814/2726560095","state":["exists","up"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6812","nonce":2854385794}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6813","nonce":2854385794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6815","nonce":2854385794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6814","nonce":2854385794}]},"public_addr":"10.20.193.31:6812/2854385794","cluster_addr":"10.20.193.31:6813/2854385794","heartbeat_back_addr":"10.20.193.31:6815/2854385794","heartbeat_front_addr":"10.20.193.31:6814/2854385794","state":["exists","up"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":359632495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":359632495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":359632495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":359632495}]},"public_addr":"10.20.193.68:6808/359632495","cluster_addr":"10.20.193.68:6809/359632495","heartbeat_back_addr":"10.20.193.68:6811/359632495","heartbeat_front_addr":"10.20.193.68:6810/359632495","state":["exists","up"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6813","nonce":85233281}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6814","nonce":85233281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6816","nonce":85233281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6815","nonce":85233281}]},"public_addr":"10.20.193.72:6813/85233281","cluster_addr":"10.20.193.72:6814/85233281","heartbeat_back_addr":"10.20.193.72:6816/85233281","heartbeat_front_addr":"10.20.193.72:6815/85233281","state":["exists","up"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6800","nonce":3085828309}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6801","nonce":3085828309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6803","nonce":3085828309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6802","nonce":3085828309}]},"public_addr":"10.20.193.21:6800/3085828309","cluster_addr":"10.20.193.21:6801/3085828309","heartbeat_back_addr":"10.20.193.21:6803/3085828309","heartbeat_front_addr":"10.20.193.21:6802/3085828309","state":["exists","up"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6800","nonce":3462355980}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6802","nonce":3462355980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6805","nonce":3462355980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6803","nonce":3462355980}]},"public_addr":"10.20.193.31:6800/3462355980","cluster_addr":"10.20.193.31:6802/3462355980","heartbeat_back_addr":"10.20.193.31:6805/3462355980","heartbeat_front_addr":"10.20.193.31:6803/3462355980","state":["exists","up"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":3680498089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":3680498089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":3680498089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":3680498089}]},"public_addr":"10.20.193.68:6800/3680498089","cluster_addr":"10.20.193.68:6801/3680498089","heartbeat_back_addr":"10.20.193.68:6803/3680498089","heartbeat_front_addr":"10.20.193.68:6802/3680498089","state":["exists","up"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6809","nonce":3875035713}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6810","nonce":3875035713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6812","nonce":3875035713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6811","nonce":3875035713}]},"public_addr":"10.20.193.72:6809/3875035713","cluster_addr":"10.20.193.72:6810/3875035713","heartbeat_back_addr":"10.20.193.72:6812/3875035713","heartbeat_front_addr":"10.20.193.72:6811/3875035713","state":["exists","up"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6808","nonce":3798667347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6809","nonce":3798667347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6811","nonce":3798667347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6810","nonce":3798667347}]},"public_addr":"10.20.193.21:6808/3798667347","cluster_addr":"10.20.193.21:6809/3798667347","heartbeat_back_addr":"10.20.193.21:6811/3798667347","heartbeat_front_addr":"10.20.193.21:6810/3798667347","state":["exists","up"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6801","nonce":981225706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6804","nonce":981225706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6807","nonce":981225706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6806","nonce":981225706}]},"public_addr":"10.20.193.31:6801/981225706","cluster_addr":"10.20.193.31:6804/981225706","heartbeat_back_addr":"10.20.193.31:6807/981225706","heartbeat_front_addr":"10.20.193.31:6806/981225706","state":["exists","up"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":3496291144}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":3496291144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":3496291144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":3496291144}]},"public_addr":"10.20.193.68:6804/3496291144","cluster_addr":"10.20.193.68:6805/3496291144","heartbeat_back_addr":"10.20.193.68:6807/3496291144","heartbeat_front_addr":"10.20.193.68:6806/3496291144","state":["exists","up"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6801","nonce":4086098431}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6802","nonce":4086098431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6804","nonce":4086098431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6803","nonce":4086098431}]},"public_addr":"10.20.193.72:6801/4086098431","cluster_addr":"10.20.193.72:6802/4086098431","heartbeat_back_addr":"10.20.193.72:6804/4086098431","heartbeat_front_addr":"10.20.193.72:6803/4086098431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.598722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.723156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.057755+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.069009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.642767+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.807896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.996712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.047731+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.574097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.570580+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.761246+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.158222+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.717157+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.733104+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.936776+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.980030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:01:13.675 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 10 librados: watch_flush enter 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 10 librados: watch_flush exit 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 20 client.4358.objecter shutdown clearing up homeless session... 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 10 client.4358.objecter successfully canceled tick 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 >> v1:10.20.193.72:6800/2463505645 conn(0x7fa1d0079ee0 legacy=0x7fa1d009a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 10 monclient: shutdown 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 >> v1:10.20.193.68:6789/0 conn(0x7fa2041626a0 legacy=0x7fa204164430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 shutdown_connections 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 >> 10.20.193.21:0/3345972631 conn(0x7fa2040b65f0 msgr2=0x7fa20413c210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:13.676 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 shutdown_connections 2026-02-25T15:01:13.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 -- 10.20.193.21:0/3345972631 wait complete. 2026-02-25T15:01:13.677 INFO:teuthology.misc.health.trial021.stderr:2026-02-25T15:01:13.673+0000 7fa20949c640 1 librados: shutdown 2026-02-25T15:01:13.682 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-25T15:01:13.682 INFO:tasks.ceph:Creating RBD pool 2026-02-25T15:01:13.683 DEBUG:teuthology.orchestra.run.trial021:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-25T15:01:13.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.747+0000 7f5a4ea74640 10 monclient: get_monmap_and_config 2026-02-25T15:01:13.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.747+0000 7f5a4ea74640 10 monclient: build_initial_monmap 2026-02-25T15:01:13.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.747+0000 7f5a4ea74640 10 monclient: monmap: 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:13.748602+0000 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:13.748602+0000 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:13.750 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.748+0000 7f5a4ea74640 1 Processor -- start 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.748+0000 7f5a4ea74640 1 -- start start 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.748+0000 7f5a4ea74640 10 monclient: init 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:13.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-c con 0x7f5a48159dc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-b con 0x7f5a4805b760 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-a con 0x7f5a4805daa0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4805bbc0 con 0x7f5a4805daa0 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480b0f40 con 0x7f5a4805b760 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480b1220 con 0x7f5a48159dc0 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4ea74640 10 monclient(hunting): authenticate will time out at 3017.341221s 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4cfea640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5a4805daa0 0x7f5a481c8b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39858/0 (socket says 10.20.193.21:39858) 2026-02-25T15:01:13.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.749+0000 7f5a4cfea640 1 -- 10.20.193.21:0/3355408713 learned_addr learned my addr 10.20.193.21:0/3355408713 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1416566673 0 0) 0x7f5a480b1220 con 0x7f5a48159dc0 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 10 monclient(hunting): my global_id is 4361 2026-02-25T15:01:13.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.752+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c003610 con 0x7f5a48159dc0 2026-02-25T15:01:13.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3543713279 0 0) 0x7f5a2c003610 con 0x7f5a48159dc0 2026-02-25T15:01:13.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 >> v1:10.20.193.31:6789/0 conn(0x7f5a4805b760 legacy=0x7f5a4805d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 >> v1:10.20.193.21:6789/0 conn(0x7f5a4805daa0 legacy=0x7f5a481c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480b1500 con 0x7f5a48159dc0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a34002df0 con 0x7f5a48159dc0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a46ffd640 10 monclient: dump: 2026-02-25T15:01:13.757 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a4ea74640 5 monclient: authenticate success, global_id 4361 2026-02-25T15:01:13.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.754+0000 7f5a4ea74640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a34003000 con 0x7f5a48159dc0 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 1 -- 10.20.193.21:0/3355408713 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a34003440 con 0x7f5a48159dc0 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 4 set_mon_vals no callback set 2026-02-25T15:01:13.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a46ffd640 10 monclient: dump: 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 10 monclient: shutdown 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 1 -- 10.20.193.21:0/3355408713 >> v1:10.20.193.68:6789/0 conn(0x7f5a48159dc0 legacy=0x7f5a480b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 1 -- 10.20.193.21:0/3355408713 shutdown_connections 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 1 -- 10.20.193.21:0/3355408713 >> 10.20.193.21:0/3355408713 conn(0x7f5a480b2f10 msgr2=0x7f5a480b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 1 -- 10.20.193.21:0/3355408713 shutdown_connections 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.755+0000 7f5a4ea74640 1 -- 10.20.193.21:0/3355408713 wait complete. 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient: build_initial_monmap 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient: monmap: 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:13.764 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 librados: starting msgr at 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 librados: starting objecter 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 Processor -- start 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 -- start start 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 librados: setting wanted keys 2026-02-25T15:01:13.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 1 librados: calling monclient init 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient: init 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-a con 0x7f5a4805b760 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.756+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-c con 0x7f5a4805daa0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 10 monclient(hunting): picked mon.noname-b con 0x7f5a48159dc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a48139f90 con 0x7f5a4805b760 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a481ff030 con 0x7f5a48159dc0 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a481ff310 con 0x7f5a4805daa0 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a4ea74640 10 monclient(hunting): authenticate will time out at 3017.349026s 2026-02-25T15:01:13.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a47fff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5a4805b760 0x7f5a481fbd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39864/0 (socket says 10.20.193.21:39864) 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a47fff640 1 -- 10.20.193.21:0/892431523 learned_addr learned my addr 10.20.193.21:0/892431523 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter ms_handle_connect 0x7f5a4805b760 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter ms_handle_connect 0x7f5a4805daa0 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter ms_handle_connect 0x7f5a48159dc0 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.757+0000 7f5a44ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282929017 0 0) 0x7f5a481ff310 con 0x7f5a4805daa0 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 10 monclient(hunting): my global_id is 4364 2026-02-25T15:01:13.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.758+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a18003610 con 0x7f5a4805daa0 2026-02-25T15:01:13.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3601041162 0 0) 0x7f5a18003610 con 0x7f5a4805daa0 2026-02-25T15:01:13.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a481ff310 con 0x7f5a4805daa0 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a38003010 con 0x7f5a4805daa0 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.770 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.762+0000 7f5a44ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2558925017 0 0) 0x7f5a481ff310 con 0x7f5a4805daa0 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 >> v1:10.20.193.31:6789/0 conn(0x7f5a48159dc0 legacy=0x7f5a4813de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 >> v1:10.20.193.21:6789/0 conn(0x7f5a4805b760 legacy=0x7f5a481fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:13.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 1 monclient: found mon.c 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481ff5f0 con 0x7f5a4805daa0 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a44ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 5 monclient: authenticate success, global_id 4364 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 10 monclient: _renew_subs 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481ff8d0 con 0x7f5a4805daa0 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 10 monclient: _renew_subs 2026-02-25T15:01:13.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a4813d740 con 0x7f5a4805daa0 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.764+0000 7f5a4ea74640 1 librados: init done 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.765+0000 7f5a4ea74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.765+0000 7f5a4ea74640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.765+0000 7f5a4ea74640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.773 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.765+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a480b08c0 con 0x7f5a4805daa0 2026-02-25T15:01:13.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a38003220 con 0x7f5a4805daa0 2026-02-25T15:01:13.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:13.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a380035f0 con 0x7f5a4805daa0 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 10 monclient: dump: 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:13.775 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:13.776 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:13.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a467fc640 4 set_mon_vals no callback set 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.773+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f5a380037d0 con 0x7f5a4805daa0 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.774+0000 7f5a47fff640 10 monclient: get_auth_request con 0x7f5a18079f60 auth_method 0 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.774+0000 7f5a44ff9640 10 client.4364.objecter ms_handle_connect 0x7f5a18079f60 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.775+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 2696637847 0 0) 0x7f5a38094aa0 con 0x7f5a4805daa0 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.775+0000 7f5a44ff9640 10 client.4364.objecter ms_dispatch2 0x7f5a48000b90 osd_map(25..25 src has 1..25) 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.775+0000 7f5a44ff9640 3 client.4364.objecter handle_osd_map got epochs [25,25] > 0 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.775+0000 7f5a44ff9640 3 client.4364.objecter handle_osd_map decoding full epoch 25 2026-02-25T15:01:13.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.775+0000 7f5a44ff9640 20 client.4364.objecter dump_active .. 0 homeless 2026-02-25T15:01:13.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.859+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f5a3805e400 con 0x7f5a4805daa0 2026-02-25T15:01:13.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.859+0000 7f5a44ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:13.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.859+0000 7f5a44ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:13.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.966+0000 7f5a4ea74640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:01:13.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.966+0000 7f5a4ea74640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:01:13.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.966+0000 7f5a4ea74640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:13.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:13.966+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f5a48059d90 con 0x7f5a4805daa0 2026-02-25T15:01:14.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.113+0000 7f5a44ff9640 1 -- 10.20.193.21:0/892431523 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v26) ==== 109+0+0 (unknown 437888687 0 0) 0x7f5a3805dd00 con 0x7f5a4805daa0 2026-02-25T15:01:14.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.113+0000 7f5a44ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-25T15:01:14.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.113+0000 7f5a44ff9640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-25T15:01:14.116 INFO:teuthology.orchestra.run.trial021.stderr:pool 'rbd' created 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 10 librados: watch_flush enter 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 10 librados: watch_flush exit 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 20 client.4364.objecter shutdown clearing up homeless session... 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 10 client.4364.objecter successfully canceled tick 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 >> v1:10.20.193.72:6800/2463505645 conn(0x7f5a18079f60 legacy=0x7f5a1809a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 10 monclient: shutdown 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 >> v1:10.20.193.68:6789/0 conn(0x7f5a4805daa0 legacy=0x7f5a48139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 shutdown_connections 2026-02-25T15:01:14.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 >> 10.20.193.21:0/892431523 conn(0x7f5a480b2f10 msgr2=0x7f5a4805c340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:14.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 shutdown_connections 2026-02-25T15:01:14.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 -- 10.20.193.21:0/892431523 wait complete. 2026-02-25T15:01:14.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.116+0000 7f5a4ea74640 1 librados: shutdown 2026-02-25T15:01:14.127 DEBUG:teuthology.orchestra.run.trial021:> rbd --cluster ceph pool init rbd 2026-02-25T15:01:14.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 10 monclient: get_monmap_and_config 2026-02-25T15:01:14.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 10 monclient: build_initial_monmap 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 10 monclient: monmap: 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:14.156811+0000 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:14.156811+0000 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:14.158 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 1 Processor -- start 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 1 -- start start 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.156+0000 7f8096f7c300 10 monclient: init 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient: _reopen_session rank -1 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-b con 0x55df29ad25d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:14.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-c con 0x55df29bbbdc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-a con 0x55df29ad29a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df2992b0c0 con 0x55df29ad29a0 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df2993aa80 con 0x55df29ad25d0 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df29ad7e90 con 0x55df29bbbdc0 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient(hunting): _renew_subs 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.157+0000 7f8096f7c300 10 monclient(hunting): authenticate will time out at 3017.749239s 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.158+0000 7f8095a31640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x55df29ad25d0 0x55df29bbb6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:45852/0 (socket says 10.20.193.21:45852) 2026-02-25T15:01:14.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.158+0000 7f8095a31640 1 -- 10.20.193.21:0/1870440150 learned_addr learned my addr 10.20.193.21:0/1870440150 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113270854 0 0) 0x55df2993aa80 con 0x55df29ad25d0 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _negotiate 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): my global_id is 4351 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807c001e10 con 0x55df29ad25d0 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561096973 0 0) 0x55df2992b0c0 con 0x55df29ad29a0 2026-02-25T15:01:14.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _negotiate 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 10 monclient(hunting): my global_id is 4332 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.159+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55df2993aa80 con 0x55df29ad29a0 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753578443 0 0) 0x7f807c001e10 con 0x55df29ad25d0 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 >> v1:10.20.193.68:6789/0 conn(0x55df29bbbdc0 legacy=0x55df29bc5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 >> v1:10.20.193.21:6789/0 conn(0x55df29ad29a0 legacy=0x55df29c2aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: _finish_hunting 0 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 monclient: found mon.noname-b 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:14.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df29ad8170 con 0x55df29ad25d0 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: _finish_auth 0 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: _check_auth_tickets 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f808c0015f0 con 0x55df29ad25d0 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8094a2f640 10 monclient: dump: 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.165 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8096f7c300 5 monclient: authenticate success, global_id 4351 2026-02-25T15:01:14.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.161+0000 7f8096f7c300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f808c001800 con 0x55df29ad25d0 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 1 -- 10.20.193.21:0/1870440150 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f808c001c40 con 0x55df29ad25d0 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 10 monclient: get_monmap_and_config success 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 4 set_mon_vals no callback set 2026-02-25T15:01:14.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8094a2f640 10 monclient: dump: 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:14.171 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 10 monclient: shutdown 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 1 -- 10.20.193.21:0/1870440150 >> v1:10.20.193.31:6789/0 conn(0x55df29ad25d0 legacy=0x55df29bbb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 1 -- 10.20.193.21:0/1870440150 shutdown_connections 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 1 -- 10.20.193.21:0/1870440150 >> 10.20.193.21:0/1870440150 conn(0x55df29b1ced0 msgr2=0x55df29b1d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 1 -- 10.20.193.21:0/1870440150 shutdown_connections 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 1 -- 10.20.193.21:0/1870440150 wait complete. 2026-02-25T15:01:14.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 10 monclient: build_initial_monmap 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.162+0000 7f8096f7c300 10 monclient: monmap: 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 librados: starting msgr at 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 librados: starting objecter 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 Processor -- start 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 -- start start 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 librados: setting wanted keys 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 librados: calling monclient init 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient: init 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient: _reopen_session rank -1 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-c con 0x55df29ad25d0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-a con 0x55df29ad29a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:14.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient(hunting): picked mon.noname-b con 0x55df29bbbdc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df29b16d80 con 0x55df29ad29a0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df29bc1fb0 con 0x55df29bbbdc0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55df29bc2290 con 0x55df29ad25d0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient(hunting): _renew_subs 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.163+0000 7f8096f7c300 10 monclient(hunting): authenticate will time out at 3017.755787s 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8095230640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x55df29ad29a0 0x55df29bc13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39882/0 (socket says 10.20.193.21:39882) 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 learned_addr learned my addr 10.20.193.21:0/1307391846 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8085ffb640 10 client.?.objecter ms_handle_connect 0x55df29ad29a0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8085ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8085ffb640 10 client.?.objecter ms_handle_connect 0x55df29bbbdc0 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.164+0000 7f8085ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:14.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675535674 0 0) 0x55df29b16d80 con 0x55df29ad29a0 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): my global_id is 4335 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8074001e10 con 0x55df29ad29a0 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543512536 0 0) 0x55df29bc1fb0 con 0x55df29bbbdc0 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 10 monclient(hunting): my global_id is 4354 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.165+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55df29b16d80 con 0x55df29bbbdc0 2026-02-25T15:01:14.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3646592585 0 0) 0x55df29b16d80 con 0x55df29bbbdc0 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55df29bc1fb0 con 0x55df29bbbdc0 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8088001c30 con 0x55df29bbbdc0 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:14.177 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.167+0000 7f8085ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1649284117 0 0) 0x7f8074001e10 con 0x55df29ad29a0 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55df29b16d80 con 0x55df29ad29a0 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8080001730 con 0x55df29ad29a0 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.168+0000 7f8085ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.178 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:14.179 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 client.?.objecter ms_handle_connect 0x55df29ad25d0 2026-02-25T15:01:14.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:14.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1384626303 0 0) 0x55df29bc1fb0 con 0x55df29bbbdc0 2026-02-25T15:01:14.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 >> v1:10.20.193.68:6789/0 conn(0x55df29ad25d0 legacy=0x55df29b16670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 >> v1:10.20.193.21:6789/0 conn(0x55df29ad29a0 legacy=0x55df29bc13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 1 monclient: found mon.b 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df29bc2570 con 0x55df29bbbdc0 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8085ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 5 monclient: authenticate success, global_id 4354 2026-02-25T15:01:14.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 monclient: _renew_subs 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55df29bc2850 con 0x55df29bbbdc0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 monclient: _renew_subs 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55df29bc1ab0 con 0x55df29bbbdc0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 1 librados: init done 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.169+0000 7f8096f7c300 10 librados: wait_for_osdmap waiting 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8088002280 con 0x55df29bbbdc0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8088002690 con 0x55df29bbbdc0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:14.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8085ffb640 10 monclient: dump: 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:14.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.177+0000 7f8087fff640 4 set_mon_vals no callback set 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.178+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f80880028a0 con 0x55df29bbbdc0 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.178+0000 7f8095a31640 10 monclient: get_auth_request con 0x7f80740786c0 auth_method 0 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.179+0000 7f8085ffb640 10 client.4354.objecter ms_handle_connect 0x7f80740786c0 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 8102+0+0 (unknown 2642963613 0 0) 0x7f80880935b0 con 0x55df29bbbdc0 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_map(26..26 src has 1..26) 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map got epochs [26,26] > 0 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map decoding full epoch 26 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8085ffb640 20 client.4354.objecter dump_active .. 0 homeless 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8096f7c300 10 librados: wait_for_osdmap done waiting 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8096f7c300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8096f7c300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:01:14.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8096f7c300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:14.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:14.180+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55df29b15e20 con 0x55df29bbbdc0 2026-02-25T15:01:15.196 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.194+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v27) ==== 141+0+0 (unknown 3716993650 0 0) 0x7f808805cf10 con 0x55df29bbbdc0 2026-02-25T15:01:15.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.194+0000 7f8085ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-25T15:01:15.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.194+0000 7f8085ffb640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-25T15:01:15.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.195+0000 7f8096f7c300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:15.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.195+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x55df299c3fb0 con 0x55df29bbbdc0 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (unknown 2135480514 0 0) 0x7f8088058b80 con 0x55df29bbbdc0 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8085ffb640 10 monclient: handle_get_version_reply finishing 1 version 27 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8087fff640 10 client.4354.objecter _get_latest_version latest 27, waiting 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8087fff640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8087fff640 10 monclient: _renew_subs 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8087fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:15.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.196+0000 7f8087fff640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=27}) -- 0x7f8070002ae0 con 0x55df29bbbdc0 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 11 ==== osd_map(27..27 src has 1..27) ==== 669+0+0 (unknown 881067900 0 0) 0x7f808805c0d0 con 0x55df29bbbdc0 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_map(27..27 src has 1..27) 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map got epochs [27,27] > 26 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map decoding incremental epoch 27 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8085ffb640 20 client.4354.objecter dump_active .. 0 homeless 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 10 librados: create oid=rbd_trash nspace= 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 10 client.4354.objecter _op_submit op 0x55df29bae5e0 2026-02-25T15:01:15.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 20 client.4354.objecter _calc_target epoch 27 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 20 client.4354.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 10 client.4354.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [15,13] primary 15 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 20 client.4354.objecter _get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 10 client.4354.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.15 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 20 client.4354.objecter get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 15 client.4354.objecter _session_op_assign 15 1 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 15 client.4354.objecter _send_op 1 to 2.3 on osd.15 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.72:6801/4086098431 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55df29c5d230 con 0x55df29b18660 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.197+0000 7f8096f7c300 5 client.4354.objecter 1 in flight 2026-02-25T15:01:15.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.198+0000 7f8095230640 10 monclient: get_auth_request con 0x55df29b18660 auth_method 0 2026-02-25T15:01:15.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.199+0000 7f8085ffb640 10 client.4354.objecter ms_handle_connect 0x55df29b18660 2026-02-25T15:01:15.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 <== osd.15 v1:10.20.193.72:6801/4086098431 1 ==== osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 3684242346 0 0) 0x7f8080004160 con 0x55df29b18660 2026-02-25T15:01:15.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 10 client.4354.objecter in handle_osd_op_reply 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 7 client.4354.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 10 client.4354.objecter op 0 rval 0 len 0 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 15 client.4354.objecter handle_osd_op_reply completed tid 1 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 15 client.4354.objecter _finish_op 1 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 15 client.4354.objecter _session_op_remove 15 1 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8095230640 5 client.4354.objecter 0 in flight 2026-02-25T15:01:16.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:15.997+0000 7f8096f7c300 10 librados: Objecter returned from create r=0 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 10 client.4354.objecter _op_submit op 0x55df29c97700 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 20 client.4354.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 20 client.4354.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 10 client.4354.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,7] primary 15 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 10 client.4354.objecter chose random osd.15 of [15,7] 2026-02-25T15:01:16.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 20 client.4354.objecter _get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 10 client.4354.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.15 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 20 client.4354.objecter get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 15 client.4354.objecter _session_op_assign 15 2 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 15 client.4354.objecter _send_op 2 to 2.2 on osd.15 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.72:6801/4086098431 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x55df29c97c30 con 0x55df29b18660 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.000+0000 7f8096f7c300 5 client.4354.objecter 1 in flight 2026-02-25T15:01:16.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 <== osd.15 v1:10.20.193.72:6801/4086098431 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1379133595 0 0) 0x7f8080004160 con 0x55df29b18660 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 10 client.4354.objecter in handle_osd_op_reply 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 7 client.4354.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 10 client.4354.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 10 client.4354.objecter op 0 rval 0 len 0 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 15 client.4354.objecter handle_osd_op_reply completed tid 2 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 15 client.4354.objecter _finish_op 2 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 15 client.4354.objecter _session_op_remove 15 2 2026-02-25T15:01:16.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8095230640 5 client.4354.objecter 0 in flight 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 10 client.4354.objecter _op_submit op 0x55df29c96860 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 20 client.4354.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 20 client.4354.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 10 client.4354.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,7] primary 15 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 10 client.4354.objecter chose random osd.15 of [15,7] 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 20 client.4354.objecter _get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 10 client.4354.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.15 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 20 client.4354.objecter get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 15 client.4354.objecter _session_op_assign 15 3 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 15 client.4354.objecter _send_op 3 to 2.2 on osd.15 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.72:6801/4086098431 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x55df29c96d10 con 0x55df29b18660 2026-02-25T15:01:16.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.014+0000 7f8096f7c300 5 client.4354.objecter 1 in flight 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 <== osd.15 v1:10.20.193.72:6801/4086098431 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1399001751 0 0) 0x7f8080004160 con 0x55df29b18660 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 10 client.4354.objecter in handle_osd_op_reply 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 7 client.4354.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 10 client.4354.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 10 client.4354.objecter op 0 rval 0 len 0 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 15 client.4354.objecter handle_osd_op_reply completed tid 3 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 15 client.4354.objecter _finish_op 3 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 15 client.4354.objecter _session_op_remove 15 3 2026-02-25T15:01:16.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f8095230640 5 client.4354.objecter 0 in flight 2026-02-25T15:01:16.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f80877fe640 10 client.4354.objecter allocate_selfmanaged_snap; pool: 2 2026-02-25T15:01:16.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f80877fe640 10 client.4354.objecter pool_op_submit 4 2026-02-25T15:01:16.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f80877fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:16.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.018+0000 7f80877fe640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f8068003110 con 0x55df29bbbdc0 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v28) ==== 55+0+0 (unknown 2808644630 0 0) 0x7f8088061ef0 con 0x55df29bbbdc0 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 pool_op_reply(tid 4 (0) Success v28) 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 client.4354.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v28) 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 client.4354.objecter have request 4 at 0x7f80680030a0 Op: create unmanaged snap 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 20 client.4354.objecter waiting for client to reach epoch 28 before calling back 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 monclient: _renew_subs 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=28}) -- 0x55df29bc1fb0 con 0x55df29bbbdc0 2026-02-25T15:01:16.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.265+0000 7f8085ffb640 10 client.4354.objecter done 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 13 ==== osd_map(28..28 src has 1..28) ==== 629+0+0 (unknown 4278823484 0 0) 0x7f808805c2d0 con 0x55df29bbbdc0 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_map(28..28 src has 1..28) 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map got epochs [28,28] > 27 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map decoding incremental epoch 28 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8085ffb640 20 client.4354.objecter dump_active .. 0 homeless 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 librados: queue_aio_write 0x55df29c92c90 completion 0x55df29bc61f0 write_seq 1 2026-02-25T15:01:16.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 10 client.4354.objecter _op_submit op 0x7f8070006400 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 client.4354.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 client.4354.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 10 client.4354.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,7] primary 15 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 client.4354.objecter _get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 10 client.4354.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.15 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 client.4354.objecter get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 15 client.4354.objecter _session_op_assign 15 5 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 15 client.4354.objecter _send_op 5 to 2.2 on osd.15 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.72:6801/4086098431 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7f8070006910 con 0x55df29b18660 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.267+0000 7f8087fff640 5 client.4354.objecter 1 in flight 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 <== osd.15 v1:10.20.193.72:6801/4086098431 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 444517681 0 0) 0x7f8080004160 con 0x55df29b18660 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 10 client.4354.objecter in handle_osd_op_reply 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 7 client.4354.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 10 client.4354.objecter op 0 rval 0 len 0 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 10 client.4354.objecter op 1 rval 0 len 0 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 15 client.4354.objecter handle_osd_op_reply completed tid 5 2026-02-25T15:01:16.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 15 client.4354.objecter _finish_op 5 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 15 client.4354.objecter _session_op_remove 15 5 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 5 client.4354.objecter 0 in flight 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f8095230640 20 librados: complete_aio_write 0x55df29bc61f0 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f80877fe640 10 client.4354.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f80877fe640 10 client.4354.objecter pool_op_submit 6 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f80877fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:16.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:16.393+0000 7f80877fe640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v28) -- 0x7f80680033b0 con 0x55df29bbbdc0 2026-02-25T15:01:17.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.164+0000 7f8084ff9640 10 monclient: tick 2026-02-25T15:01:17.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.164+0000 7f8084ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:17.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.164+0000 7f8084ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:17.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.164+0000 7f8084ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:17.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v29) ==== 43+0+0 (unknown 71379753 0 0) 0x7f8088067080 con 0x55df29bbbdc0 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 pool_op_reply(tid 6 (0) Success v29) 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 client.4354.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v29) 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 client.4354.objecter have request 6 at 0x7f80680030a0 Op: delete unmanaged snap 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 20 client.4354.objecter waiting for client to reach epoch 29 before calling back 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 monclient: _renew_subs 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=29}) -- 0x7f8074001e10 con 0x55df29bbbdc0 2026-02-25T15:01:17.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.310+0000 7f8085ffb640 10 client.4354.objecter done 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8085ffb640 1 -- 10.20.193.21:0/1307391846 <== mon.1 v1:10.20.193.31:6789/0 15 ==== osd_map(29..29 src has 1..29) ==== 657+0+0 (unknown 2152034103 0 0) 0x7f808805a510 con 0x55df29bbbdc0 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8085ffb640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_map(29..29 src has 1..29) 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map got epochs [29,29] > 28 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8085ffb640 3 client.4354.objecter handle_osd_map decoding incremental epoch 29 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8085ffb640 20 client.4354.objecter dump_active .. 0 homeless 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 librados: queue_aio_write 0x55df29c92c90 completion 0x7f8068001da0 write_seq 2 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 10 client.4354.objecter _op_submit op 0x7f8070006400 2026-02-25T15:01:17.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 client.4354.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 client.4354.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 10 client.4354.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [15,7] primary 15 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 client.4354.objecter _get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 10 client.4354.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.15 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 client.4354.objecter get_session s=0x55df29944280 osd=15 3 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 15 client.4354.objecter _session_op_assign 15 7 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 15 client.4354.objecter _send_op 7 to 2.2 on osd.15 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 1 -- 10.20.193.21:0/1307391846 --> v1:10.20.193.72:6801/4086098431 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x7f8070006e40 con 0x55df29b18660 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:17.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.311+0000 7f8087fff640 5 client.4354.objecter 1 in flight 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 1 -- 10.20.193.21:0/1307391846 <== osd.15 v1:10.20.193.72:6801/4086098431 5 ==== osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 2480773985 0 0) 0x7f8080004160 con 0x55df29b18660 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 10 client.4354.objecter ms_dispatch2 0x55df299e7d50 osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 10 client.4354.objecter in handle_osd_op_reply 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 7 client.4354.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 10 client.4354.objecter op 0 rval 0 len 0 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 15 client.4354.objecter handle_osd_op_reply completed tid 7 2026-02-25T15:01:17.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 15 client.4354.objecter _finish_op 7 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 20 client.4354.objecter put_session s=0x55df29944280 osd=15 4 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 15 client.4354.objecter _session_op_remove 15 7 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 5 client.4354.objecter 0 in flight 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8095230640 20 librados: complete_aio_write 0x7f8068001da0 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 10 librados: watch_flush enter 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 10 librados: watch_flush exit 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 10 client.4354.objecter close_session for osd.15 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 >> v1:10.20.193.72:6801/4086098431 conn(0x55df29b18660 legacy=0x55df29c5bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 20 client.4354.objecter put_session s=0x55df29944280 osd=15 1 2026-02-25T15:01:17.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 20 client.4354.objecter shutdown clearing up homeless session... 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 10 client.4354.objecter successfully canceled tick 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 >> v1:10.20.193.72:6800/2463505645 conn(0x7f80740786c0 legacy=0x7f8074098b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 10 monclient: shutdown 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 >> v1:10.20.193.31:6789/0 conn(0x55df29bbbdc0 legacy=0x55df29b15500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096cba640 1 -- 10.20.193.21:0/1307391846 reap_dead start 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 shutdown_connections 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 >> 10.20.193.21:0/1307391846 conn(0x55df29b1ced0 msgr2=0x55df29b1a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 shutdown_connections 2026-02-25T15:01:17.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 -- 10.20.193.21:0/1307391846 wait complete. 2026-02-25T15:01:17.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.415+0000 7f8096f7c300 1 librados: shutdown 2026-02-25T15:01:17.422 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-25T15:01:17.423 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-25T15:01:17.424 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-25T15:01:17.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 10 monclient: get_monmap_and_config 2026-02-25T15:01:17.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 10 monclient: build_initial_monmap 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 10 monclient: monmap: 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:17.528944+0000 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:17.528944+0000 2026-02-25T15:01:17.531 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.532 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 1 Processor -- start 2026-02-25T15:01:17.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 1 -- start start 2026-02-25T15:01:17.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.528+0000 7f9bb4da2640 10 monclient: init 2026-02-25T15:01:17.545 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:17.545 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:17.545 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-c con 0x7f9bb015d0c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:17.545 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-b con 0x7f9bb00b0ca0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-a con 0x7f9bb00b28b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00b8540 con 0x7f9bb00b28b0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00b5da0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00b6080 con 0x7f9bb015d0c0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9bb4da2640 10 monclient(hunting): authenticate will time out at 3021.121517s 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9baed76640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9bb00b28b0 0x7f9bb00b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39886/0 (socket says 10.20.193.21:39886) 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.529+0000 7f9baed76640 1 -- 10.20.193.21:0/117712250 learned_addr learned my addr 10.20.193.21:0/117712250 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805942981 0 0) 0x7f9bb00b8540 con 0x7f9bb00b28b0 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): my global_id is 4338 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b9c003610 con 0x7f9bb00b28b0 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835998218 0 0) 0x7f9bb00b6080 con 0x7f9bb015d0c0 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): my global_id is 4370 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb00b8540 con 0x7f9bb015d0c0 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595671682 0 0) 0x7f9bb00b5da0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 10 monclient(hunting): my global_id is 4357 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.531+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb00b6080 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 777804082 0 0) 0x7f9b9c003610 con 0x7f9bb00b28b0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 >> v1:10.20.193.68:6789/0 conn(0x7f9bb015d0c0 legacy=0x7f9bb00b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 >> v1:10.20.193.31:6789/0 conn(0x7f9bb00b0ca0 legacy=0x7f9bb00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: _finish_hunting 0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 monclient: found mon.noname-a 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb0163e10 con 0x7f9bb00b28b0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: _finish_auth 0 2026-02-25T15:01:17.548 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: _check_auth_tickets 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9ba0003170 con 0x7f9bb00b28b0 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: dump: 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.549 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bb4da2640 5 monclient: authenticate success, global_id 4338 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bb4da2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ba0003340 con 0x7f9bb00b28b0 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 1 -- 10.20.193.21:0/117712250 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9ba0003780 con 0x7f9bb00b28b0 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:17.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bad573640 10 monclient: dump: 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bb4da2640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:17.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.533+0000 7f9bb4da2640 4 set_mon_vals no callback set 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 10 monclient: shutdown 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 -- 10.20.193.21:0/117712250 >> v1:10.20.193.21:6789/0 conn(0x7f9bb00b28b0 legacy=0x7f9bb00b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 -- 10.20.193.21:0/117712250 shutdown_connections 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 -- 10.20.193.21:0/117712250 >> 10.20.193.21:0/117712250 conn(0x7f9bb00b5290 msgr2=0x7f9bb00b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 -- 10.20.193.21:0/117712250 shutdown_connections 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 -- 10.20.193.21:0/117712250 wait complete. 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 10 monclient: build_initial_monmap 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 10 monclient: monmap: 2026-02-25T15:01:17.552 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:17.553 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 librados: starting msgr at 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.534+0000 7f9bb4da2640 1 librados: starting objecter 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:17.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 Processor -- start 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 -- start start 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 librados: setting wanted keys 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 librados: calling monclient init 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient: init 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:17.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-a con 0x7f9bb00b0ca0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-b con 0x7f9bb00b28b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient(hunting): picked mon.noname-c con 0x7f9bb015d0c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb0156ef0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb00b72a0 con 0x7f9bb00b28b0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb01fb770 con 0x7f9bb015d0c0 2026-02-25T15:01:17.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bb4da2640 10 monclient(hunting): authenticate will time out at 3021.127619s 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bae575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9bb00b0ca0 0x7f9bb0136340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39894/0 (socket says 10.20.193.21:39894) 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.535+0000 7f9bae575640 1 -- 10.20.193.21:0/1642144479 learned_addr learned my addr 10.20.193.21:0/1642144479 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter ms_handle_connect 0x7f9bb00b0ca0 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter ms_handle_connect 0x7f9bb015d0c0 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter ms_handle_connect 0x7f9bb00b28b0 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.536+0000 7f9b96ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906444364 0 0) 0x7f9bb0156ef0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): my global_id is 4341 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b7c003610 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944942678 0 0) 0x7f9bb01fb770 con 0x7f9bb015d0c0 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): my global_id is 4373 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb0156ef0 con 0x7f9bb015d0c0 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803923377 0 0) 0x7f9bb00b72a0 con 0x7f9bb00b28b0 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 10 monclient(hunting): my global_id is 4360 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.537+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb01fb770 con 0x7f9bb00b28b0 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1064881016 0 0) 0x7f9b7c003610 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bb00b72a0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9ba40030f0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:17.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.562 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 531345167 0 0) 0x7f9bb0156ef0 con 0x7f9bb015d0c0 2026-02-25T15:01:17.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b7c003610 con 0x7f9bb015d0c0 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9ba00034f0 con 0x7f9bb015d0c0 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.564 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.565 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1335569282 0 0) 0x7f9bb01fb770 con 0x7f9bb00b28b0 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bb0156ef0 con 0x7f9bb00b28b0 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9b98003150 con 0x7f9bb00b28b0 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:17.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.539+0000 7f9b96ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.567 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1138167837 0 0) 0x7f9bb00b72a0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 >> v1:10.20.193.68:6789/0 conn(0x7f9bb015d0c0 legacy=0x7f9bb00b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 >> v1:10.20.193.31:6789/0 conn(0x7f9bb00b28b0 legacy=0x7f9bb01567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:17.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 1 monclient: found mon.a 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb01fba50 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9b96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:17.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 5 monclient: authenticate success, global_id 4341 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _renew_subs 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb01fbd30 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 client.4341.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _renew_subs 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9bb0155f90 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 1 librados: init done 2026-02-25T15:01:17.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.541+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb005e210 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ba4003480 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9ba4003b50 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9bacd72640 4 set_mon_vals no callback set 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.632+0000 7f9b96ffd640 10 monclient: dump: 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.635 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.636 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.636 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.636 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.636 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.633+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f9ba4003d30 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.634+0000 7f9badd74640 10 monclient: get_auth_request con 0x7f9b7c079fd0 auth_method 0 2026-02-25T15:01:17.637 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.634+0000 7f9b96ffd640 10 client.4341.objecter ms_handle_connect 0x7f9b7c079fd0 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f9ba4095af0 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 10 client.4341.objecter ms_dispatch2 0x7f9bb0000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 3 client.4341.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 3 client.4341.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 20 client.4341.objecter dump_active .. 0 homeless 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f9ba405f450 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.638 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.636+0000 7f9b96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:17.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.743+0000 7f9bb4da2640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:01:17.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.743+0000 7f9bb4da2640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:01:17.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.743+0000 7f9bb4da2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:17.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.743+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9bb00b4c40 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.751 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.750+0000 7f9b96ffd640 1 -- 10.20.193.21:0/1642144479 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f9ba4003b50 con 0x7f9bb00b0ca0 2026-02-25T15:01:17.751 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.750+0000 7f9b96ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-25T15:01:17.751 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.750+0000 7f9b96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:17.752 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:17.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 10 librados: watch_flush enter 2026-02-25T15:01:17.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 10 librados: watch_flush exit 2026-02-25T15:01:17.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 20 client.4341.objecter shutdown clearing up homeless session... 2026-02-25T15:01:17.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 10 client.4341.objecter successfully canceled tick 2026-02-25T15:01:17.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 >> v1:10.20.193.72:6800/2463505645 conn(0x7f9b7c079fd0 legacy=0x7f9b7c09a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 10 monclient: shutdown 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 >> v1:10.20.193.21:6789/0 conn(0x7f9bb00b0ca0 legacy=0x7f9bb0136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 shutdown_connections 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 >> 10.20.193.21:0/1642144479 conn(0x7f9bb00b5290 msgr2=0x7f9bb00b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 shutdown_connections 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 -- 10.20.193.21:0/1642144479 wait complete. 2026-02-25T15:01:17.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.752+0000 7f9bb4da2640 1 librados: shutdown 2026-02-25T15:01:17.761 INFO:teuthology.orchestra.run.trial021.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-25T15:01:17.762 INFO:tasks.ceph_manager:config epoch is 1 2026-02-25T15:01:17.762 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T15:01:17.762 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T15:01:17.762 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.829+0000 7f7d98d67640 10 monclient: get_monmap_and_config 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.829+0000 7f7d98d67640 10 monclient: build_initial_monmap 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.829+0000 7f7d98d67640 10 monclient: monmap: 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:17.830380+0000 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:17.830380+0000 2026-02-25T15:01:17.831 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:17.832 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.832 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:17.832 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:17.832 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:17.832 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 1 Processor -- start 2026-02-25T15:01:17.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 1 -- start start 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient: init 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-b con 0x7f7d94058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-c con 0x7f7d940b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-a con 0x7f7d941626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d941655c0 con 0x7f7d941626a0 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940b12b0 con 0x7f7d94058da0 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d940b1590 con 0x7f7d940b0410 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:17.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.830+0000 7f7d98d67640 10 monclient(hunting): authenticate will time out at 3021.422921s 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.831+0000 7f7d92575640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f7d94058da0 0x7f7d941647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:45892/0 (socket says 10.20.193.21:45892) 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.831+0000 7f7d92575640 1 -- 10.20.193.21:0/2917910238 learned_addr learned my addr 10.20.193.21:0/2917910238 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618287002 0 0) 0x7f7d940b12b0 con 0x7f7d94058da0 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): my global_id is 4363 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d80003610 con 0x7f7d94058da0 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884905375 0 0) 0x7f7d941655c0 con 0x7f7d941626a0 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): my global_id is 4344 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d940b12b0 con 0x7f7d941626a0 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1418848230 0 0) 0x7f7d940b1590 con 0x7f7d940b0410 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 10 monclient(hunting): my global_id is 4376 2026-02-25T15:01:17.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.832+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d941655c0 con 0x7f7d940b0410 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2284127996 0 0) 0x7f7d80003610 con 0x7f7d94058da0 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 >> v1:10.20.193.68:6789/0 conn(0x7f7d940b0410 legacy=0x7f7d94164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 >> v1:10.20.193.21:6789/0 conn(0x7f7d941626a0 legacy=0x7f7d941c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: _finish_hunting 0 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 monclient: found mon.noname-b 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d940b1870 con 0x7f7d94058da0 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: _finish_auth 0 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: _check_auth_tickets 2026-02-25T15:01:17.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d88002df0 con 0x7f7d94058da0 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d91573640 10 monclient: dump: 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.844 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d98d67640 5 monclient: authenticate success, global_id 4363 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.834+0000 7f7d98d67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d88002fc0 con 0x7f7d94058da0 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 1 -- 10.20.193.21:0/2917910238 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d88003400 con 0x7f7d94058da0 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d91573640 10 monclient: dump: 2026-02-25T15:01:17.845 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 4 set_mon_vals no callback set 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 10 monclient: shutdown 2026-02-25T15:01:17.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 1 -- 10.20.193.21:0/2917910238 >> v1:10.20.193.31:6789/0 conn(0x7f7d94058da0 legacy=0x7f7d941647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 1 -- 10.20.193.21:0/2917910238 shutdown_connections 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 1 -- 10.20.193.21:0/2917910238 >> 10.20.193.21:0/2917910238 conn(0x7f7d940b65f0 msgr2=0x7f7d940b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 1 -- 10.20.193.21:0/2917910238 shutdown_connections 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 1 -- 10.20.193.21:0/2917910238 wait complete. 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 10 monclient: build_initial_monmap 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.835+0000 7f7d98d67640 10 monclient: monmap: 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:17.847 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 librados: starting msgr at 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 librados: starting objecter 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 Processor -- start 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 -- start start 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 librados: setting wanted keys 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 librados: calling monclient init 2026-02-25T15:01:17.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient: init 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-c con 0x7f7d94058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-a con 0x7f7d940b0410 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient(hunting): picked mon.noname-b con 0x7f7d941626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9413aeb0 con 0x7f7d940b0410 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9405ba00 con 0x7f7d941626a0 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9405bce0 con 0x7f7d94058da0 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d98d67640 10 monclient(hunting): authenticate will time out at 3021.428661s 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d91d74640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f7d940b0410 0x7f7d941fb3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39902/0 (socket says 10.20.193.21:39902) 2026-02-25T15:01:17.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.836+0000 7f7d91d74640 1 -- 10.20.193.21:0/544086728 learned_addr learned my addr 10.20.193.21:0/544086728 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter ms_handle_connect 0x7f7d940b0410 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter ms_handle_connect 0x7f7d941626a0 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter ms_handle_connect 0x7f7d94058da0 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.837+0000 7f7d7affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197395023 0 0) 0x7f7d9405ba00 con 0x7f7d941626a0 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): my global_id is 4366 2026-02-25T15:01:17.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d60003610 con 0x7f7d941626a0 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176290515 0 0) 0x7f7d9413aeb0 con 0x7f7d940b0410 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): my global_id is 4347 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9405ba00 con 0x7f7d940b0410 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253050332 0 0) 0x7f7d9405bce0 con 0x7f7d94058da0 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 10 monclient(hunting): my global_id is 4379 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.838+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9413aeb0 con 0x7f7d94058da0 2026-02-25T15:01:17.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4005192520 0 0) 0x7f7d9413aeb0 con 0x7f7d94058da0 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d9405bce0 con 0x7f7d94058da0 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d88003310 con 0x7f7d94058da0 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.852 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3752976990 0 0) 0x7f7d60003610 con 0x7f7d941626a0 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d9413aeb0 con 0x7f7d941626a0 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d840032f0 con 0x7f7d941626a0 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.840+0000 7f7d7affd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.853 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1550305727 0 0) 0x7f7d9405ba00 con 0x7f7d940b0410 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d60003610 con 0x7f7d940b0410 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d7c003170 con 0x7f7d940b0410 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:17.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.841+0000 7f7d7affd640 10 monclient(hunting): dump: 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.855 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 85844434 0 0) 0x7f7d9405bce0 con 0x7f7d94058da0 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 >> v1:10.20.193.31:6789/0 conn(0x7f7d941626a0 legacy=0x7f7d9413c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 >> v1:10.20.193.21:6789/0 conn(0x7f7d940b0410 legacy=0x7f7d941fb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 1 monclient: found mon.c 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:17.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9405bfc0 con 0x7f7d94058da0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 5 monclient: authenticate success, global_id 4379 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _renew_subs 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9405c2a0 con 0x7f7d94058da0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 client.4379.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _renew_subs 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:17.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d9405c860 con 0x7f7d94058da0 2026-02-25T15:01:17.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 1 librados: init done 2026-02-25T15:01:17.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:17.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.842+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d940b6ca0 con 0x7f7d94058da0 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d88002990 con 0x7f7d94058da0 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7d88004b80 con 0x7f7d94058da0 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d90d72640 4 set_mon_vals no callback set 2026-02-25T15:01:17.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.932+0000 7f7d7affd640 10 monclient: dump: 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:17.935 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.933+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f7d8801e060 con 0x7f7d94058da0 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.933+0000 7f7d91d74640 10 monclient: get_auth_request con 0x7f7d6007a090 auth_method 0 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 10 client.4379.objecter ms_handle_connect 0x7f7d6007a090 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f7d88095900 con 0x7f7d94058da0 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 10 client.4379.objecter ms_dispatch2 0x7f7d94000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 3 client.4379.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 3 client.4379.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:17.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.934+0000 7f7d7affd640 20 client.4379.objecter dump_active .. 0 homeless 2026-02-25T15:01:17.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.936+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f7d8805f260 con 0x7f7d94058da0 2026-02-25T15:01:17.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.936+0000 7f7d7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:17.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:17.936+0000 7f7d7affd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:18.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.071+0000 7f7d98d67640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:01:18.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.071+0000 7f7d98d67640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:01:18.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.071+0000 7f7d98d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:18.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.071+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f7d940b69c0 con 0x7f7d94058da0 2026-02-25T15:01:18.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.115+0000 7f7d7affd640 1 -- 10.20.193.21:0/544086728 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+196440 (unknown 481731318 0 796537603) 0x7f7d8805eb60 con 0x7f7d94058da0 2026-02-25T15:01:18.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.115+0000 7f7d7affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-25T15:01:18.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.115+0000 7f7d7affd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:18.120 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:18.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 10 librados: watch_flush enter 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 10 librados: watch_flush exit 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 20 client.4379.objecter shutdown clearing up homeless session... 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 10 client.4379.objecter successfully canceled tick 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 >> v1:10.20.193.72:6800/2463505645 conn(0x7f7d6007a090 legacy=0x7f7d6009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 10 monclient: shutdown 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 >> v1:10.20.193.68:6789/0 conn(0x7f7d94058da0 legacy=0x7f7d941fc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 shutdown_connections 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 >> 10.20.193.21:0/544086728 conn(0x7f7d940b65f0 msgr2=0x7f7d94059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 shutdown_connections 2026-02-25T15:01:18.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 -- 10.20.193.21:0/544086728 wait complete. 2026-02-25T15:01:18.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.116+0000 7f7d98d67640 1 librados: shutdown 2026-02-25T15:01:18.126 INFO:teuthology.orchestra.run.trial021.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6800","nonce":2463505645}]},"active_addr":"10.20.193.72:6800/2463505645","active_change":"2026-02-25T15:00:35.639203+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.72:0","nonce":3882470858}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.72:0","nonce":2438051819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.72:0","nonce":4254694038}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.72:0","nonce":220638516}]}]} 2026-02-25T15:01:18.133 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T15:01:18.133 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T15:01:18.134 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:01:18.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 10 monclient: monmap: 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.233919+0000 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.233919+0000 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.235 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.236 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.236 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.236 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.236 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 1 Processor -- start 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 1 -- start start 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.233+0000 7f2a4a5a3640 10 monclient: init 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-c con 0x7f2a44055bf0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-a con 0x7f2a44164040 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-b con 0x7f2a44055fc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a440b3a00 con 0x7f2a44164040 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a440b3c70 con 0x7f2a44055fc0 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a440b3f50 con 0x7f2a44055bf0 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a4a5a3640 10 monclient(hunting): authenticate will time out at 3021.826308s 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a43fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f2a44055bf0 0x7f2a440b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39390/0 (socket says 10.20.193.21:39390) 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.234+0000 7f2a43fff640 1 -- 10.20.193.21:0/2348989465 learned_addr learned my addr 10.20.193.21:0/2348989465 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101500446 0 0) 0x7f2a440b3f50 con 0x7f2a44055bf0 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): my global_id is 4382 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a28003610 con 0x7f2a44055bf0 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937618608 0 0) 0x7f2a440b3c70 con 0x7f2a44055fc0 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): my global_id is 4369 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a440b3f50 con 0x7f2a44055fc0 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963537640 0 0) 0x7f2a440b3a00 con 0x7f2a44164040 2026-02-25T15:01:18.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 10 monclient(hunting): my global_id is 4350 2026-02-25T15:01:18.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.236+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a440b3c70 con 0x7f2a44164040 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102076902 0 0) 0x7f2a28003610 con 0x7f2a44055bf0 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 >> v1:10.20.193.31:6789/0 conn(0x7f2a44055fc0 legacy=0x7f2a440b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 >> v1:10.20.193.21:6789/0 conn(0x7f2a44164040 legacy=0x7f2a44056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a440b4230 con 0x7f2a44055bf0 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2a30002df0 con 0x7f2a44055bf0 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a42ffd640 10 monclient: dump: 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.246 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a4a5a3640 5 monclient: authenticate success, global_id 4382 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.237+0000 7f2a4a5a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a30002fc0 con 0x7f2a44055bf0 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:18.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 1 -- 10.20.193.21:0/2348989465 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2a30003400 con 0x7f2a44055bf0 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a42ffd640 10 monclient: dump: 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.248 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a4a5a3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.238+0000 7f2a4a5a3640 4 set_mon_vals no callback set 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 10 monclient: shutdown 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2348989465 >> v1:10.20.193.68:6789/0 conn(0x7f2a44055bf0 legacy=0x7f2a440b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2348989465 shutdown_connections 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2348989465 >> 10.20.193.21:0/2348989465 conn(0x7f2a440b7bb0 msgr2=0x7f2a440b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2348989465 shutdown_connections 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2348989465 wait complete. 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 10 monclient: monmap: 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 librados: starting msgr at 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 librados: starting objecter 2026-02-25T15:01:18.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 Processor -- start 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 -- start start 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 librados: setting wanted keys 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 1 librados: calling monclient init 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.239+0000 7f2a4a5a3640 10 monclient: init 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-c con 0x7f2a44055bf0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-b con 0x7f2a44055fc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient(hunting): picked mon.noname-a con 0x7f2a44164040 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4413cbb0 con 0x7f2a44164040 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4413ce90 con 0x7f2a44055fc0 2026-02-25T15:01:18.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a4413d170 con 0x7f2a44055bf0 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a4a5a3640 10 monclient(hunting): authenticate will time out at 3021.832213s 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a48b19640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f2a44164040 0x7f2a440b99f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39914/0 (socket says 10.20.193.21:39914) 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a48b19640 1 -- 10.20.193.21:0/2673244495 learned_addr learned my addr 10.20.193.21:0/2673244495 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a40ff9640 10 client.?.objecter ms_handle_connect 0x7f2a44164040 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a40ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a40ff9640 10 client.?.objecter ms_handle_connect 0x7f2a44055fc0 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.240+0000 7f2a40ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473170106 0 0) 0x7f2a4413ce90 con 0x7f2a44055fc0 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): my global_id is 4372 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a14003610 con 0x7f2a44055fc0 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 client.?.objecter ms_handle_connect 0x7f2a44055bf0 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460188503 0 0) 0x7f2a4413cbb0 con 0x7f2a44164040 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 10 monclient(hunting): my global_id is 4353 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.241+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a4413ce90 con 0x7f2a44164040 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675592775 0 0) 0x7f2a4413d170 con 0x7f2a44055bf0 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 10 monclient(hunting): my global_id is 4385 2026-02-25T15:01:18.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.242+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a4413cbb0 con 0x7f2a44055bf0 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3318129302 0 0) 0x7f2a14003610 con 0x7f2a44055fc0 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a4413d170 con 0x7f2a44055fc0 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2a34002fb0 con 0x7f2a44055fc0 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.257 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4289187583 0 0) 0x7f2a4413ce90 con 0x7f2a44164040 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a14003610 con 0x7f2a44164040 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2a38003470 con 0x7f2a44164040 2026-02-25T15:01:18.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.244+0000 7f2a40ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.259 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3044212657 0 0) 0x7f2a4413d170 con 0x7f2a44055fc0 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 >> v1:10.20.193.68:6789/0 conn(0x7f2a44055bf0 legacy=0x7f2a44162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 >> v1:10.20.193.21:6789/0 conn(0x7f2a44164040 legacy=0x7f2a440b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 1 monclient: found mon.b 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4413d450 con 0x7f2a44055fc0 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a40ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a4a5a3640 5 monclient: authenticate success, global_id 4372 2026-02-25T15:01:18.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a4a5a3640 10 monclient: _renew_subs 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a4a5a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.245+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4413d730 con 0x7f2a44055fc0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 client.4372.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 monclient: _renew_subs 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a4413a1f0 con 0x7f2a44055fc0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 1 librados: init done 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.246+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a44139540 con 0x7f2a44055fc0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a34003700 con 0x7f2a44055fc0 2026-02-25T15:01:18.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2a340038b0 con 0x7f2a44055fc0 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a427fc640 4 set_mon_vals no callback set 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 10 monclient: dump: 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.262 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.263 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.263 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.254+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f2a3401cdd0 con 0x7f2a44055fc0 2026-02-25T15:01:18.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.255+0000 7f2a43fff640 10 monclient: get_auth_request con 0x7f2a14079fc0 auth_method 0 2026-02-25T15:01:18.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.255+0000 7f2a40ff9640 10 client.4372.objecter ms_handle_connect 0x7f2a14079fc0 2026-02-25T15:01:18.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.256+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f2a340949d0 con 0x7f2a44055fc0 2026-02-25T15:01:18.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.256+0000 7f2a40ff9640 10 client.4372.objecter ms_dispatch2 0x7f2a44000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:18.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.256+0000 7f2a40ff9640 3 client.4372.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:18.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.256+0000 7f2a40ff9640 3 client.4372.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:18.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.256+0000 7f2a40ff9640 20 client.4372.objecter dump_active .. 0 homeless 2026-02-25T15:01:18.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.343+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f2a3405e330 con 0x7f2a44055fc0 2026-02-25T15:01:18.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.343+0000 7f2a40ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.343+0000 7f2a40ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:18.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.450+0000 7f2a4a5a3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.450+0000 7f2a4a5a3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.450+0000 7f2a4a5a3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:18.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.450+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a44157bf0 con 0x7f2a44055fc0 2026-02-25T15:01:18.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.496+0000 7f2a40ff9640 1 -- 10.20.193.21:0/2673244495 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20864 (unknown 3676990683 0 3199695153) 0x7f2a3405dc30 con 0x7f2a44055fc0 2026-02-25T15:01:18.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.496+0000 7f2a40ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.496+0000 7f2a40ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:18.499 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:18.499 INFO:teuthology.orchestra.run.trial021.stdout:{"epoch":29,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:01:17.231014+0000","last_up_change":"2026-02-25T15:01:06.008609+0000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:01:05.912164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:01:13.971952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6804","nonce":2253484549}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6805","nonce":2253484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6807","nonce":2253484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6806","nonce":2253484549}]},"public_addr":"10.20.193.21:6804/2253484549","cluster_addr":"10.20.193.21:6805/2253484549","heartbeat_back_addr":"10.20.193.21:6807/2253484549","heartbeat_front_addr":"10.20.193.21:6806/2253484549","state":["exists","up"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6808","nonce":1809978267}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6809","nonce":1809978267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6811","nonce":1809978267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6810","nonce":1809978267}]},"public_addr":"10.20.193.31:6808/1809978267","cluster_addr":"10.20.193.31:6809/1809978267","heartbeat_back_addr":"10.20.193.31:6811/1809978267","heartbeat_front_addr":"10.20.193.31:6810/1809978267","state":["exists","up"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":3838375510}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":3838375510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":3838375510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":3838375510}]},"public_addr":"10.20.193.68:6812/3838375510","cluster_addr":"10.20.193.68:6813/3838375510","heartbeat_back_addr":"10.20.193.68:6815/3838375510","heartbeat_front_addr":"10.20.193.68:6814/3838375510","state":["exists","up"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6805","nonce":464837367}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6806","nonce":464837367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6808","nonce":464837367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6807","nonce":464837367}]},"public_addr":"10.20.193.72:6805/464837367","cluster_addr":"10.20.193.72:6806/464837367","heartbeat_back_addr":"10.20.193.72:6808/464837367","heartbeat_front_addr":"10.20.193.72:6807/464837367","state":["exists","up"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6812","nonce":2726560095}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6813","nonce":2726560095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6815","nonce":2726560095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6814","nonce":2726560095}]},"public_addr":"10.20.193.21:6812/2726560095","cluster_addr":"10.20.193.21:6813/2726560095","heartbeat_back_addr":"10.20.193.21:6815/2726560095","heartbeat_front_addr":"10.20.193.21:6814/2726560095","state":["exists","up"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6812","nonce":2854385794}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6813","nonce":2854385794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6815","nonce":2854385794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6814","nonce":2854385794}]},"public_addr":"10.20.193.31:6812/2854385794","cluster_addr":"10.20.193.31:6813/2854385794","heartbeat_back_addr":"10.20.193.31:6815/2854385794","heartbeat_front_addr":"10.20.193.31:6814/2854385794","state":["exists","up"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":359632495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":359632495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":359632495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":359632495}]},"public_addr":"10.20.193.68:6808/359632495","cluster_addr":"10.20.193.68:6809/359632495","heartbeat_back_addr":"10.20.193.68:6811/359632495","heartbeat_front_addr":"10.20.193.68:6810/359632495","state":["exists","up"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6813","nonce":85233281}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6814","nonce":85233281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6816","nonce":85233281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6815","nonce":85233281}]},"public_addr":"10.20.193.72:6813/85233281","cluster_addr":"10.20.193.72:6814/85233281","heartbeat_back_addr":"10.20.193.72:6816/85233281","heartbeat_front_addr":"10.20.193.72:6815/85233281","state":["exists","up"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6800","nonce":3085828309}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6801","nonce":3085828309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6803","nonce":3085828309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6802","nonce":3085828309}]},"public_addr":"10.20.193.21:6800/3085828309","cluster_addr":"10.20.193.21:6801/3085828309","heartbeat_back_addr":"10.20.193.21:6803/3085828309","heartbeat_front_addr":"10.20.193.21:6802/3085828309","state":["exists","up"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6800","nonce":3462355980}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6802","nonce":3462355980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6805","nonce":3462355980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6803","nonce":3462355980}]},"public_addr":"10.20.193.31:6800/3462355980","cluster_addr":"10.20.193.31:6802/3462355980","heartbeat_back_addr":"10.20.193.31:6805/3462355980","heartbeat_front_addr":"10.20.193.31:6803/3462355980","state":["exists","up"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":3680498089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":3680498089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":3680498089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":3680498089}]},"public_addr":"10.20.193.68:6800/3680498089","cluster_addr":"10.20.193.68:6801/3680498089","heartbeat_back_addr":"10.20.193.68:6803/3680498089","heartbeat_front_addr":"10.20.193.68:6802/3680498089","state":["exists","up"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6809","nonce":3875035713}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6810","nonce":3875035713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6812","nonce":3875035713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6811","nonce":3875035713}]},"public_addr":"10.20.193.72:6809/3875035713","cluster_addr":"10.20.193.72:6810/3875035713","heartbeat_back_addr":"10.20.193.72:6812/3875035713","heartbeat_front_addr":"10.20.193.72:6811/3875035713","state":["exists","up"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6808","nonce":3798667347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6809","nonce":3798667347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6811","nonce":3798667347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6810","nonce":3798667347}]},"public_addr":"10.20.193.21:6808/3798667347","cluster_addr":"10.20.193.21:6809/3798667347","heartbeat_back_addr":"10.20.193.21:6811/3798667347","heartbeat_front_addr":"10.20.193.21:6810/3798667347","state":["exists","up"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6801","nonce":981225706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6804","nonce":981225706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6807","nonce":981225706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6806","nonce":981225706}]},"public_addr":"10.20.193.31:6801/981225706","cluster_addr":"10.20.193.31:6804/981225706","heartbeat_back_addr":"10.20.193.31:6807/981225706","heartbeat_front_addr":"10.20.193.31:6806/981225706","state":["exists","up"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":3496291144}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":3496291144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":3496291144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":3496291144}]},"public_addr":"10.20.193.68:6804/3496291144","cluster_addr":"10.20.193.68:6805/3496291144","heartbeat_back_addr":"10.20.193.68:6807/3496291144","heartbeat_front_addr":"10.20.193.68:6806/3496291144","state":["exists","up"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6801","nonce":4086098431}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6802","nonce":4086098431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6804","nonce":4086098431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6803","nonce":4086098431}]},"public_addr":"10.20.193.72:6801/4086098431","cluster_addr":"10.20.193.72:6802/4086098431","heartbeat_back_addr":"10.20.193.72:6804/4086098431","heartbeat_front_addr":"10.20.193.72:6803/4086098431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.598722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.723156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.057755+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.069009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.642767+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.807896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.996712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.047731+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.574097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.570580+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.761246+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.158222+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.717157+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.733104+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.936776+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.980030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 10 librados: watch_flush enter 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 10 librados: watch_flush exit 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 20 client.4372.objecter shutdown clearing up homeless session... 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 10 client.4372.objecter successfully canceled tick 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 >> v1:10.20.193.72:6800/2463505645 conn(0x7f2a14079fc0 legacy=0x7f2a1409a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 10 monclient: shutdown 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 >> v1:10.20.193.31:6789/0 conn(0x7f2a44055fc0 legacy=0x7f2a44139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 shutdown_connections 2026-02-25T15:01:18.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 >> 10.20.193.21:0/2673244495 conn(0x7f2a440b7bb0 msgr2=0x7f2a440b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 shutdown_connections 2026-02-25T15:01:18.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.497+0000 7f2a4a5a3640 1 -- 10.20.193.21:0/2673244495 wait complete. 2026-02-25T15:01:18.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.498+0000 7f2a4a5a3640 1 librados: shutdown 2026-02-25T15:01:18.509 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T15:01:18.509 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:01:18.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 10 monclient: monmap: 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.575058+0000 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.575058+0000 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.576 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.577 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.577 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.577 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.577 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 1 Processor -- start 2026-02-25T15:01:18.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 1 -- start start 2026-02-25T15:01:18.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.574+0000 7f74df8b9640 10 monclient: init 2026-02-25T15:01:18.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:18.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-a con 0x7f74d8055bf0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-b con 0x7f74d8164040 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-c con 0x7f74d8055fc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d80b3a00 con 0x7f74d8055bf0 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d80b3c70 con 0x7f74d8164040 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d80b3f50 con 0x7f74d8055fc0 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74df8b9640 10 monclient(hunting): authenticate will time out at 3022.167428s 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74dd62e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f74d8055bf0 0x7f74d80b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39924/0 (socket says 10.20.193.21:39924) 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74dd62e640 1 -- 10.20.193.21:0/3776476219 learned_addr learned my addr 10.20.193.21:0/3776476219 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.575+0000 7f74dde2f640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f74d8055fc0 0x7f74d80b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39406/0 (socket says 10.20.193.21:39406) 2026-02-25T15:01:18.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723928236 0 0) 0x7f74d80b3f50 con 0x7f74d8055fc0 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): my global_id is 4388 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74c0003610 con 0x7f74d8055fc0 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587038166 0 0) 0x7f74d80b3a00 con 0x7f74d8055bf0 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): my global_id is 4356 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d80b3f50 con 0x7f74d8055bf0 2026-02-25T15:01:18.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232371462 0 0) 0x7f74d80b3c70 con 0x7f74d8164040 2026-02-25T15:01:18.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 10 monclient(hunting): my global_id is 4375 2026-02-25T15:01:18.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.577+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d80b3a00 con 0x7f74d8164040 2026-02-25T15:01:18.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765925728 0 0) 0x7f74c0003610 con 0x7f74d8055fc0 2026-02-25T15:01:18.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 >> v1:10.20.193.31:6789/0 conn(0x7f74d8164040 legacy=0x7f74d8056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 >> v1:10.20.193.21:6789/0 conn(0x7f74d8055bf0 legacy=0x7f74d80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 monclient: found mon.noname-c 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80b4230 con 0x7f74d8055fc0 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74d4003170 con 0x7f74d8055fc0 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74c7fff640 10 monclient: dump: 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.591 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74df8b9640 5 monclient: authenticate success, global_id 4388 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.578+0000 7f74df8b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74d4003310 con 0x7f74d8055fc0 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 1 -- 10.20.193.21:0/3776476219 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74d4003750 con 0x7f74d8055fc0 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74c7fff640 10 monclient: dump: 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.592 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74df8b9640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.579+0000 7f74df8b9640 4 set_mon_vals no callback set 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 10 monclient: shutdown 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- 10.20.193.21:0/3776476219 >> v1:10.20.193.68:6789/0 conn(0x7f74d8055fc0 legacy=0x7f74d80b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- 10.20.193.21:0/3776476219 shutdown_connections 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- 10.20.193.21:0/3776476219 >> 10.20.193.21:0/3776476219 conn(0x7f74d80b7bb0 msgr2=0x7f74d80b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- 10.20.193.21:0/3776476219 shutdown_connections 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- 10.20.193.21:0/3776476219 wait complete. 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 10 monclient: monmap: 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.594 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 librados: starting msgr at 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 librados: starting objecter 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 Processor -- start 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 -- start start 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 librados: setting wanted keys 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 1 librados: calling monclient init 2026-02-25T15:01:18.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.580+0000 7f74df8b9640 10 monclient: init 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-b con 0x7f74d8055bf0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-c con 0x7f74d8055fc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient(hunting): picked mon.noname-a con 0x7f74d8164040 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d813d330 con 0x7f74d8164040 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d813ad10 con 0x7f74d8055bf0 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d813aff0 con 0x7f74d8055fc0 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74df8b9640 10 monclient(hunting): authenticate will time out at 3022.173274s 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74dde2f640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f74d8164040 0x7f74d811ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:39940/0 (socket says 10.20.193.21:39940) 2026-02-25T15:01:18.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74dde2f640 1 -- 10.20.193.21:0/2522291033 learned_addr learned my addr 10.20.193.21:0/2522291033 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter ms_handle_connect 0x7f74d8164040 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter ms_handle_connect 0x7f74d8055bf0 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter ms_handle_connect 0x7f74d8055fc0 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.581+0000 7f74c5ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655452693 0 0) 0x7f74d813d330 con 0x7f74d8164040 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): my global_id is 4359 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a8003610 con 0x7f74d8164040 2026-02-25T15:01:18.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263736812 0 0) 0x7f74d813ad10 con 0x7f74d8055bf0 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): my global_id is 4378 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d813d330 con 0x7f74d8055bf0 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31901450 0 0) 0x7f74d813aff0 con 0x7f74d8055fc0 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 10 monclient(hunting): my global_id is 4391 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.582+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d813ad10 con 0x7f74d8055fc0 2026-02-25T15:01:18.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.584+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3258693988 0 0) 0x7f74a8003610 con 0x7f74d8164040 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.584+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74d813aff0 con 0x7f74d8164040 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74d40036e0 con 0x7f74d8164040 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.599 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 944018520 0 0) 0x7f74d813ad10 con 0x7f74d8055fc0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74a8003610 con 0x7f74d8055fc0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1519520546 0 0) 0x7f74d813d330 con 0x7f74d8055bf0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74d813ad10 con 0x7f74d8055bf0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74c8003070 con 0x7f74d8055bf0 2026-02-25T15:01:18.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.601 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74cc002ec0 con 0x7f74d8055fc0 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.585+0000 7f74c5ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.602 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 97223207 0 0) 0x7f74d813aff0 con 0x7f74d8164040 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 >> v1:10.20.193.68:6789/0 conn(0x7f74d8055fc0 legacy=0x7f74d813cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 >> v1:10.20.193.31:6789/0 conn(0x7f74d8055bf0 legacy=0x7f74d813c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 1 monclient: found mon.a 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d813b2d0 con 0x7f74d8164040 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74df8b9640 5 monclient: authenticate success, global_id 4359 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74df8b9640 10 monclient: _renew_subs 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74df8b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.586+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74d813b5b0 con 0x7f74d8164040 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 monclient: _renew_subs 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74d8137310 con 0x7f74d8164040 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 1 librados: init done 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.587+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d8160c90 con 0x7f74d8164040 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74d40032c0 con 0x7f74d8164040 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f74d4004f00 con 0x7f74d8164040 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 10 monclient: dump: 2026-02-25T15:01:18.682 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c77fe640 4 set_mon_vals no callback set 2026-02-25T15:01:18.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.680+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f74d401e3e0 con 0x7f74d8164040 2026-02-25T15:01:18.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.681+0000 7f74dd62e640 10 monclient: get_auth_request con 0x7f74a807a070 auth_method 0 2026-02-25T15:01:18.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.681+0000 7f74c5ffb640 10 client.4359.objecter ms_handle_connect 0x7f74a807a070 2026-02-25T15:01:18.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f74d4095dc0 con 0x7f74d8164040 2026-02-25T15:01:18.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 10 client.4359.objecter ms_dispatch2 0x7f74d8000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:18.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 3 client.4359.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:18.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 3 client.4359.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:18.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-25T15:01:18.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f74d405f720 con 0x7f74d8164040 2026-02-25T15:01:18.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:18.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.683+0000 7f74c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:18.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.788+0000 7f74df8b9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.788+0000 7f74df8b9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.788+0000 7f74df8b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.788+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74d8154e20 con 0x7f74d8164040 2026-02-25T15:01:18.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.834+0000 7f74c5ffb640 1 -- 10.20.193.21:0/2522291033 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20864 (unknown 3676990683 0 3199695153) 0x7f74d405f020 con 0x7f74d8164040 2026-02-25T15:01:18.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.834+0000 7f74c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:01:18.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.834+0000 7f74c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:18.837 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:18.837 INFO:teuthology.orchestra.run.trial021.stdout:{"epoch":29,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:01:17.231014+0000","last_up_change":"2026-02-25T15:01:06.008609+0000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:01:05.912164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:01:13.971952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6804","nonce":2253484549}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6805","nonce":2253484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6807","nonce":2253484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6806","nonce":2253484549}]},"public_addr":"10.20.193.21:6804/2253484549","cluster_addr":"10.20.193.21:6805/2253484549","heartbeat_back_addr":"10.20.193.21:6807/2253484549","heartbeat_front_addr":"10.20.193.21:6806/2253484549","state":["exists","up"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6808","nonce":1809978267}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6809","nonce":1809978267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6811","nonce":1809978267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6810","nonce":1809978267}]},"public_addr":"10.20.193.31:6808/1809978267","cluster_addr":"10.20.193.31:6809/1809978267","heartbeat_back_addr":"10.20.193.31:6811/1809978267","heartbeat_front_addr":"10.20.193.31:6810/1809978267","state":["exists","up"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":3838375510}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":3838375510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":3838375510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":3838375510}]},"public_addr":"10.20.193.68:6812/3838375510","cluster_addr":"10.20.193.68:6813/3838375510","heartbeat_back_addr":"10.20.193.68:6815/3838375510","heartbeat_front_addr":"10.20.193.68:6814/3838375510","state":["exists","up"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6805","nonce":464837367}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6806","nonce":464837367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6808","nonce":464837367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6807","nonce":464837367}]},"public_addr":"10.20.193.72:6805/464837367","cluster_addr":"10.20.193.72:6806/464837367","heartbeat_back_addr":"10.20.193.72:6808/464837367","heartbeat_front_addr":"10.20.193.72:6807/464837367","state":["exists","up"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6812","nonce":2726560095}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6813","nonce":2726560095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6815","nonce":2726560095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6814","nonce":2726560095}]},"public_addr":"10.20.193.21:6812/2726560095","cluster_addr":"10.20.193.21:6813/2726560095","heartbeat_back_addr":"10.20.193.21:6815/2726560095","heartbeat_front_addr":"10.20.193.21:6814/2726560095","state":["exists","up"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6812","nonce":2854385794}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6813","nonce":2854385794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6815","nonce":2854385794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6814","nonce":2854385794}]},"public_addr":"10.20.193.31:6812/2854385794","cluster_addr":"10.20.193.31:6813/2854385794","heartbeat_back_addr":"10.20.193.31:6815/2854385794","heartbeat_front_addr":"10.20.193.31:6814/2854385794","state":["exists","up"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":359632495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":359632495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":359632495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":359632495}]},"public_addr":"10.20.193.68:6808/359632495","cluster_addr":"10.20.193.68:6809/359632495","heartbeat_back_addr":"10.20.193.68:6811/359632495","heartbeat_front_addr":"10.20.193.68:6810/359632495","state":["exists","up"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6813","nonce":85233281}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6814","nonce":85233281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6816","nonce":85233281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6815","nonce":85233281}]},"public_addr":"10.20.193.72:6813/85233281","cluster_addr":"10.20.193.72:6814/85233281","heartbeat_back_addr":"10.20.193.72:6816/85233281","heartbeat_front_addr":"10.20.193.72:6815/85233281","state":["exists","up"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6800","nonce":3085828309}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6801","nonce":3085828309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6803","nonce":3085828309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6802","nonce":3085828309}]},"public_addr":"10.20.193.21:6800/3085828309","cluster_addr":"10.20.193.21:6801/3085828309","heartbeat_back_addr":"10.20.193.21:6803/3085828309","heartbeat_front_addr":"10.20.193.21:6802/3085828309","state":["exists","up"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6800","nonce":3462355980}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6802","nonce":3462355980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6805","nonce":3462355980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6803","nonce":3462355980}]},"public_addr":"10.20.193.31:6800/3462355980","cluster_addr":"10.20.193.31:6802/3462355980","heartbeat_back_addr":"10.20.193.31:6805/3462355980","heartbeat_front_addr":"10.20.193.31:6803/3462355980","state":["exists","up"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":3680498089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":3680498089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":3680498089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":3680498089}]},"public_addr":"10.20.193.68:6800/3680498089","cluster_addr":"10.20.193.68:6801/3680498089","heartbeat_back_addr":"10.20.193.68:6803/3680498089","heartbeat_front_addr":"10.20.193.68:6802/3680498089","state":["exists","up"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6809","nonce":3875035713}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6810","nonce":3875035713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6812","nonce":3875035713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6811","nonce":3875035713}]},"public_addr":"10.20.193.72:6809/3875035713","cluster_addr":"10.20.193.72:6810/3875035713","heartbeat_back_addr":"10.20.193.72:6812/3875035713","heartbeat_front_addr":"10.20.193.72:6811/3875035713","state":["exists","up"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6808","nonce":3798667347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6809","nonce":3798667347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6811","nonce":3798667347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6810","nonce":3798667347}]},"public_addr":"10.20.193.21:6808/3798667347","cluster_addr":"10.20.193.21:6809/3798667347","heartbeat_back_addr":"10.20.193.21:6811/3798667347","heartbeat_front_addr":"10.20.193.21:6810/3798667347","state":["exists","up"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6801","nonce":981225706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6804","nonce":981225706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6807","nonce":981225706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6806","nonce":981225706}]},"public_addr":"10.20.193.31:6801/981225706","cluster_addr":"10.20.193.31:6804/981225706","heartbeat_back_addr":"10.20.193.31:6807/981225706","heartbeat_front_addr":"10.20.193.31:6806/981225706","state":["exists","up"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":3496291144}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":3496291144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":3496291144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":3496291144}]},"public_addr":"10.20.193.68:6804/3496291144","cluster_addr":"10.20.193.68:6805/3496291144","heartbeat_back_addr":"10.20.193.68:6807/3496291144","heartbeat_front_addr":"10.20.193.68:6806/3496291144","state":["exists","up"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6801","nonce":4086098431}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6802","nonce":4086098431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6804","nonce":4086098431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6803","nonce":4086098431}]},"public_addr":"10.20.193.72:6801/4086098431","cluster_addr":"10.20.193.72:6802/4086098431","heartbeat_back_addr":"10.20.193.72:6804/4086098431","heartbeat_front_addr":"10.20.193.72:6803/4086098431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.598722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.723156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.057755+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.069009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.642767+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.807896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.996712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.047731+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.574097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.570580+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.761246+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.158222+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.717157+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.733104+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.936776+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.980030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:01:18.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 10 librados: watch_flush enter 2026-02-25T15:01:18.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 10 librados: watch_flush exit 2026-02-25T15:01:18.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 20 client.4359.objecter shutdown clearing up homeless session... 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 10 client.4359.objecter successfully canceled tick 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 >> v1:10.20.193.72:6800/2463505645 conn(0x7f74a807a070 legacy=0x7f74a809a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 10 monclient: shutdown 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 >> v1:10.20.193.21:6789/0 conn(0x7f74d8164040 legacy=0x7f74d811ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 shutdown_connections 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 >> 10.20.193.21:0/2522291033 conn(0x7f74d80b7bb0 msgr2=0x7f74d80b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 shutdown_connections 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 -- 10.20.193.21:0/2522291033 wait complete. 2026-02-25T15:01:18.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.836+0000 7f74df8b9640 1 librados: shutdown 2026-02-25T15:01:18.850 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T15:01:18.851 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T15:01:18.852 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T15:01:18.852 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T15:01:18.853 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-25T15:01:18.854 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-25T15:01:18.854 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-25T15:01:18.855 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-25T15:01:18.856 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-25T15:01:18.857 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-25T15:01:18.858 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-25T15:01:18.858 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-25T15:01:18.858 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-25T15:01:18.859 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-25T15:01:18.860 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-25T15:01:18.860 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-25T15:01:18.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.939+0000 7f992e85b640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.939+0000 7f992e85b640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.939+0000 7f992e85b640 10 monclient: monmap: 2026-02-25T15:01:18.942 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.942 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.940670+0000 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.940670+0000 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f992e85b640 1 Processor -- start 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f992e85b640 1 -- start start 2026-02-25T15:01:18.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f992e85b640 10 monclient: init 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f4a43fc3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f4a43fc3640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.940+0000 7f4a43fc3640 10 monclient: monmap: 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.941560+0000 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.941560+0000 2026-02-25T15:01:18.944 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f4a43fc3640 1 Processor -- start 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f4a43fc3640 1 -- start start 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f4a43fc3640 10 monclient: init 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-c con 0x7f992815d070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-a con 0x7f992815d440 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-b con 0x7f9928166f60 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9928164e60 con 0x7f992815d440 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99280b1790 con 0x7f9928166f60 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99280b1a70 con 0x7f992815d070 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f992e85b640 10 monclient(hunting): authenticate will time out at 3022.533351s 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f9927fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f992815d070 0x7f9928164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39420/0 (socket says 10.20.193.21:39420) 2026-02-25T15:01:18.947 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.941+0000 7f9927fff640 1 -- 10.20.193.21:0/1206187793 learned_addr learned my addr 10.20.193.21:0/1206187793 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-b con 0x7f4a3c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-a con 0x7f4a3c0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-c con 0x7f4a3c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c163930 con 0x7f4a3c0ba350 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c163bb0 con 0x7f4a3c0b9f80 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c163e90 con 0x7f4a3c0585e0 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.942+0000 7f4a43fc3640 10 monclient(hunting): authenticate will time out at 3022.534396s 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054211544 0 0) 0x7f99280b1a70 con 0x7f992815d070 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): my global_id is 4394 2026-02-25T15:01:18.950 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f990c003610 con 0x7f992815d070 2026-02-25T15:01:18.950 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f4a42539640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f4a3c0585e0 0x7f4a3c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39430/0 (socket says 10.20.193.21:39430) 2026-02-25T15:01:18.950 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f4a42539640 1 -- 10.20.193.21:0/913223998 learned_addr learned my addr 10.20.193.21:0/913223998 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281075270 0 0) 0x7f99280b1790 con 0x7f9928166f60 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 10 monclient(hunting): my global_id is 4381 2026-02-25T15:01:18.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99280b1a70 con 0x7f9928166f60 2026-02-25T15:01:18.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f7993867640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f7993867640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.943+0000 7f7993867640 10 monclient: monmap: 2026-02-25T15:01:18.952 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.944693+0000 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.944693+0000 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.953 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.954 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.954 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136854177 0 0) 0x7f9928164e60 con 0x7f992815d440 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 10 monclient(hunting): my global_id is 4362 2026-02-25T15:01:18.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99280b1790 con 0x7f992815d440 2026-02-25T15:01:18.956 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f0541a8a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.956 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f0541a8a640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.956 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f0541a8a640 10 monclient: monmap: 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.945130+0000 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.945130+0000 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.957 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.958 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.958 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.958 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.959 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f7993867640 1 Processor -- start 2026-02-25T15:01:18.959 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f7993867640 1 -- start start 2026-02-25T15:01:18.959 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f7993867640 10 monclient: init 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f3d0c29f640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f3d0c29f640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.944+0000 7f3d0c29f640 10 monclient: monmap: 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.960 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.945449+0000 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.945449+0000 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.961 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.962 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 1 Processor -- start 2026-02-25T15:01:18.962 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692193317 0 0) 0x7f4a30002910 con 0x7f4a3c0ba350 2026-02-25T15:01:18.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 10 monclient(hunting): my global_id is 4365 2026-02-25T15:01:18.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a24003610 con 0x7f4a3c0ba350 2026-02-25T15:01:18.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 1 -- start start 2026-02-25T15:01:18.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 10 monclient: init 2026-02-25T15:01:18.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254787317 0 0) 0x7f990c003610 con 0x7f992815d070 2026-02-25T15:01:18.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 >> v1:10.20.193.31:6789/0 conn(0x7f9928166f60 legacy=0x7f99280b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 1 Processor -- start 2026-02-25T15:01:18.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 >> v1:10.20.193.21:6789/0 conn(0x7f992815d440 legacy=0x7f9928166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:18.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99280b1d50 con 0x7f992815d070 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9914002df0 con 0x7f992815d070 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f992e85b640 5 monclient: authenticate success, global_id 4394 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f992e85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f9926ffd640 10 monclient: dump: 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.968 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.969 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.970 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.970 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f992e85b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:18.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7fe6e450a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7fe6e450a640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7fe6e450a640 10 monclient: monmap: 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.946045+0000 2026-02-25T15:01:18.971 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.946045+0000 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.972 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 1 -- start start 2026-02-25T15:01:18.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 10 monclient: init 2026-02-25T15:01:18.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:18.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient(hunting): picked mon.noname-b con 0x7f798c15d5d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient(hunting): picked mon.noname-a con 0x7f798c057480 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient(hunting): picked mon.noname-c con 0x7f798c0b4ba0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c1611b0 con 0x7f798c057480 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c160350 con 0x7f798c15d5d0 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c160630 con 0x7f798c0b4ba0 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f7993867640 10 monclient(hunting): authenticate will time out at 3022.537346s 2026-02-25T15:01:18.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:18.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-b con 0x7f053c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:18.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7fe6e450a640 1 Processor -- start 2026-02-25T15:01:18.978 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-c con 0x7f3d040b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.978 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.945+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-c con 0x7f053c0ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-b con 0x7f3d040ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-a con 0x7f053c0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c163930 con 0x7f053c0585e0 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c163bb0 con 0x7f053c0b9f80 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c163e90 con 0x7f053c0ba350 2026-02-25T15:01:18.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-a con 0x7f3d040585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f0541a8a640 10 monclient(hunting): authenticate will time out at 3022.538092s 2026-02-25T15:01:18.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d04163930 con 0x7f3d040585e0 2026-02-25T15:01:18.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d04163bb0 con 0x7f3d040ba350 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d04163e90 con 0x7f3d040b9f80 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7f3d0c29f640 10 monclient(hunting): authenticate will time out at 3022.538147s 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 1 -- start start 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient: init 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-b con 0x7fe6dc0b9f30 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-a con 0x7fe6dc0b7110 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-c con 0x7fe6dc0ba300 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc1680a0 con 0x7fe6dc0b7110 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc168380 con 0x7fe6dc0b9f30 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc0b5610 con 0x7fe6dc0ba300 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.946+0000 7fe6e450a640 10 monclient(hunting): authenticate will time out at 3022.538892s 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977677256 0 0) 0x7f4a3c163e90 con 0x7f4a3c0585e0 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 10 monclient(hunting): my global_id is 4397 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a30002910 con 0x7f4a3c0585e0 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9914003000 con 0x7f992815d070 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f9926ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f9926ffd640 1 -- 10.20.193.21:0/1206187793 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9914003400 con 0x7f992815d070 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f992e85b640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f992e85b640 4 set_mon_vals no callback set 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f053affd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f053c0ba350 0x7f053c057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39446/0 (socket says 10.20.193.21:39446) 2026-02-25T15:01:18.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f053affd640 1 -- 10.20.193.21:0/3984957231 learned_addr learned my addr 10.20.193.21:0/3984957231 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f7991ddd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f798c0b4ba0 0x7f798c0b6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39432/0 (socket says 10.20.193.21:39432) 2026-02-25T15:01:18.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.947+0000 7f7991ddd640 1 -- 10.20.193.21:0/3185352424 learned_addr learned my addr 10.20.193.21:0/3185352424 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f9926ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f9926ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f9926ffd640 10 monclient: dump: 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 10 monclient: shutdown 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 1 -- 10.20.193.21:0/1206187793 >> v1:10.20.193.68:6789/0 conn(0x7f992815d070 legacy=0x7f9928164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 1 -- 10.20.193.21:0/1206187793 shutdown_connections 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 1 -- 10.20.193.21:0/1206187793 >> 10.20.193.21:0/1206187793 conn(0x7f99280b2ef0 msgr2=0x7f99280b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 1 -- 10.20.193.21:0/1206187793 shutdown_connections 2026-02-25T15:01:18.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f992e85b640 1 -- 10.20.193.21:0/1206187793 wait complete. 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f3d0a014640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3d040b9f80 0x7f3d04163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39460/0 (socket says 10.20.193.21:39460) 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f3d0a014640 1 -- 10.20.193.21:0/3209544198 learned_addr learned my addr 10.20.193.21:0/3209544198 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 10 monclient: monmap: 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.949066+0000 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.949066+0000 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.986 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938358 0 0) 0x7f4a3c163bb0 con 0x7f4a3c0b9f80 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 10 monclient(hunting): my global_id is 4384 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3c163e90 con 0x7f4a3c0b9f80 2026-02-25T15:01:18.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f807d71a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f807d71a640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7f807d71a640 10 monclient: monmap: 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.949433+0000 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.949433+0000 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 1 Processor -- start 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 1 -- start start 2026-02-25T15:01:18.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.948+0000 7fbc0659b640 10 monclient: init 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 1 Processor -- start 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 10 monclient: monmap: 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.989 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 1 -- start start 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient: init 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fe6e227f640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe6dc0b9f30 0x7fe6dc16b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:45986/0 (socket says 10.20.193.21:45986) 2026-02-25T15:01:18.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fe6e227f640 1 -- 10.20.193.21:0/922120759 learned_addr learned my addr 10.20.193.21:0/922120759 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-a con 0x7fbc000b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-b con 0x7fbc000ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-c con 0x7fbc000585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00163930 con 0x7fbc000b9f80 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00163bb0 con 0x7fbc000ba350 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00163e90 con 0x7fbc000585e0 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7fbc0659b640 10 monclient(hunting): authenticate will time out at 3022.541671s 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 librados: starting msgr at 2026-02-25T15:01:18.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 librados: starting objecter 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-b con 0x7f80780b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-c con 0x7f80780ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.992 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 Processor -- start 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-a con 0x7f80780585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078163930 con 0x7f80780585e0 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 -- start start 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078163bb0 con 0x7f80780b9f80 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 librados: setting wanted keys 2026-02-25T15:01:18.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f992e85b640 1 librados: calling monclient init 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078163e90 con 0x7f80780ba350 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.949+0000 7f807d71a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f807d71a640 10 monclient(hunting): authenticate will time out at 3022.542014s 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient: init 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:18.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-c con 0x7f992815d070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-b con 0x7f992815d440 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.950+0000 7f992e85b640 10 monclient(hunting): picked mon.noname-a con 0x7f9928166f60 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f992e85b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f992812b1a0 con 0x7f9928166f60 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f992e85b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9928129710 con 0x7f992815d440 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f992e85b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99281299f0 con 0x7f992815d070 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f992e85b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f992e85b640 10 monclient(hunting): authenticate will time out at 3022.543118s 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 10 monclient: get_monmap_and_config 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 10 monclient: build_initial_monmap 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 10 monclient: monmap: 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.951924+0000 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.951924+0000 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:18.995 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 1 Processor -- start 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 1 -- start start 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.951+0000 7f7b35a16640 10 monclient: init 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156504776 0 0) 0x7f053c163e90 con 0x7f053c0ba350 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:18.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 10 monclient(hunting): my global_id is 4403 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-a con 0x7f7b300b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-c con 0x7f7b300ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-b con 0x7f7b300585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b30163930 con 0x7f7b300b9f80 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b30163bb0 con 0x7f7b300585e0 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b30163e90 con 0x7f7b300ba350 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f7b35a16640 10 monclient(hunting): authenticate will time out at 3022.544343s 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0520003610 con 0x7f053c0ba350 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7fbc04b11640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbc000585e0 0x7fbc00166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39480/0 (socket says 10.20.193.21:39480) 2026-02-25T15:01:18.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7fbc04b11640 1 -- 10.20.193.21:0/149988228 learned_addr learned my addr 10.20.193.21:0/149988228 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2516641325 0 0) 0x7f4a24003610 con 0x7f4a3c0ba350 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 >> v1:10.20.193.68:6789/0 conn(0x7f4a3c0585e0 legacy=0x7f4a3c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 >> v1:10.20.193.31:6789/0 conn(0x7f4a3c0b9f80 legacy=0x7f4a3c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: _finish_hunting 0 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 monclient: found mon.noname-a 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c0573f0 con 0x7f4a3c0ba350 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: _finish_auth 0 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: _check_auth_tickets 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4a30002fc0 con 0x7f4a3c0ba350 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a40d36640 10 monclient: dump: 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:18.998 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a43fc3640 5 monclient: authenticate success, global_id 4365 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.952+0000 7f4a43fc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098428710 0 0) 0x7f053c163bb0 con 0x7f053c0b9f80 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 10 monclient(hunting): my global_id is 4387 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f053c163e90 con 0x7f053c0b9f80 2026-02-25T15:01:18.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602040157 0 0) 0x7f798c160350 con 0x7f798c15d5d0 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 10 monclient(hunting): my global_id is 4390 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79740058a0 con 0x7f798c15d5d0 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f263041e640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f263041e640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f263041e640 10 monclient: monmap: 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.954185+0000 2026-02-25T15:01:19.000 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.954185+0000 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.953+0000 7f263041e640 1 Processor -- start 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 1 -- start start 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient: init 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173901754 0 0) 0x7fe6dc168380 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 10 monclient(hunting): my global_id is 4393 2026-02-25T15:01:19.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6c4003610 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f992cdd1640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9928166f60 0x7f992815a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40010/0 (socket says 10.20.193.21:40010) 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f992cdd1640 1 -- 10.20.193.21:0/1435042611 learned_addr learned my addr 10.20.193.21:0/1435042611 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient(hunting): picked mon.noname-a con 0x7f26280b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient(hunting): picked mon.noname-c con 0x7f26280ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415844455 0 0) 0x7f3d04163bb0 con 0x7f3d040ba350 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 10 monclient(hunting): my global_id is 4396 2026-02-25T15:01:19.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec003610 con 0x7f3d040ba350 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient(hunting): picked mon.noname-b con 0x7f26280585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2628163930 con 0x7f26280b9f80 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2628163bb0 con 0x7f26280585e0 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2628163e90 con 0x7f26280ba350 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f263041e640 10 monclient(hunting): authenticate will time out at 3022.546722s 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f8076ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f80780b9f80 0x7f8078163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:45994/0 (socket says 10.20.193.21:45994) 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f8076ffd640 1 -- 10.20.193.21:0/2557427976 learned_addr learned my addr 10.20.193.21:0/2557427976 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159346624 0 0) 0x7f3d04163e90 con 0x7f3d040b9f80 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345209547 0 0) 0x7f798c160630 con 0x7f798c0b4ba0 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 10 monclient(hunting): my global_id is 4406 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 10 monclient(hunting): my global_id is 4400 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d04163bb0 con 0x7f3d040b9f80 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.954+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f798c160350 con 0x7f798c0b4ba0 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f9924ff9640 10 client.?.objecter ms_handle_connect 0x7f9928166f60 2026-02-25T15:01:19.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.955+0000 7f9924ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.956+0000 7f9924ff9640 10 client.?.objecter ms_handle_connect 0x7f992815d440 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.956+0000 7f9924ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083125758 0 0) 0x7fbc00163e90 con 0x7fbc000585e0 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 10 monclient(hunting): my global_id is 4412 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe4003610 con 0x7fbc000585e0 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7f9924ff9640 10 client.?.objecter ms_handle_connect 0x7f992815d070 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7f9924ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7f987eaf3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7f987eaf3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.957+0000 7f987eaf3640 10 monclient: monmap: 2026-02-25T15:01:19.005 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.958550+0000 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.958550+0000 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f7b2effd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f7b300b9f80 0x7f7b30163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40022/0 (socket says 10.20.193.21:40022) 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f7b2effd640 1 -- 10.20.193.21:0/55168210 learned_addr learned my addr 10.20.193.21:0/55168210 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f4071945640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f4071945640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f4071945640 10 monclient: monmap: 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.959085+0000 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.959085+0000 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.006 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 1 Processor -- start 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 1 -- start start 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient: init 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-a con 0x7f987815deb0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-b con 0x7f987815e280 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-c con 0x7f98780ba3b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f987eaf3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98780b5880 con 0x7f987815deb0 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f987eaf3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98780b5b60 con 0x7f987815e280 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f987eaf3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98780b5e40 con 0x7f98780ba3b0 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f987eaf3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f987eaf3640 10 monclient(hunting): authenticate will time out at 3022.551033s 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188841967 0 0) 0x7f798c1611b0 con 0x7f798c057480 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 10 monclient(hunting): my global_id is 4371 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.958+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f798c160630 con 0x7f798c057480 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f4071945640 1 Processor -- start 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f4071945640 1 -- start start 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7f4071945640 10 monclient: init 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7ff0a192e640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7ff0a192e640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.959+0000 7ff0a192e640 10 monclient: monmap: 2026-02-25T15:01:19.008 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.960405+0000 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.960405+0000 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient(hunting): picked mon.noname-a con 0x7f406c159a70 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient(hunting): picked mon.noname-b con 0x7f406c159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient(hunting): picked mon.noname-c con 0x7f406c058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c163930 con 0x7f406c159a70 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c163bf0 con 0x7f406c159e40 2026-02-25T15:01:19.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c163ed0 con 0x7f406c058070 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 1 Processor -- start 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f4071945640 10 monclient(hunting): authenticate will time out at 3022.552201s 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 1 -- start start 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient: init 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113194055 0 0) 0x7f3d00002c90 con 0x7f3d040585e0 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 10 monclient(hunting): my global_id is 4368 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d04163e90 con 0x7f3d040585e0 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 10 monclient: monmap: 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.961054+0000 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.961054+0000 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f406affd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f406c159a70 0x7f406c0b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40054/0 (socket says 10.20.193.21:40054) 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f406affd640 1 -- 10.20.193.21:0/404877026 learned_addr learned my addr 10.20.193.21:0/404877026 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-a con 0x7ff09c0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 1 Processor -- start 2026-02-25T15:01:19.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-b con 0x7ff09c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-c con 0x7ff09c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c163930 con 0x7ff09c0b9f80 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c163bb0 con 0x7ff09c0ba350 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c163e90 con 0x7ff09c0585e0 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7ff0a192e640 10 monclient(hunting): authenticate will time out at 3022.552956s 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 1 -- start start 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.960+0000 7f51e7f02640 10 monclient: init 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f262e994640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f26280585e0 0x7f2628166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46022/0 (socket says 10.20.193.21:46022) 2026-02-25T15:01:19.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f262e994640 1 -- 10.20.193.21:0/1601072104 learned_addr learned my addr 10.20.193.21:0/1601072104 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-c con 0x7f51e00b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f0d324c6640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f0d324c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f0d324c6640 10 monclient: monmap: 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.962395+0000 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.962395+0000 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.014 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-b con 0x7f51e00ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-a con 0x7f51e00585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e0163930 con 0x7f51e00585e0 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e0163bb0 con 0x7f51e00ba350 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e0163e90 con 0x7f51e00b9f80 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.961+0000 7f51e7f02640 10 monclient(hunting): authenticate will time out at 3022.553721s 2026-02-25T15:01:19.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 1 Processor -- start 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 108301005 0 0) 0x7f0520003610 con 0x7f053c0ba350 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 >> v1:10.20.193.31:6789/0 conn(0x7f053c0b9f80 legacy=0x7f053c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 >> v1:10.20.193.21:6789/0 conn(0x7f053c0585e0 legacy=0x7f053c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c0573f0 con 0x7f053c0ba350 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f052c002df0 con 0x7f053c0ba350 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f053a7fc640 10 monclient: dump: 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0541a8a640 5 monclient: authenticate success, global_id 4403 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0541a8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 1 -- start start 2026-02-25T15:01:19.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient: init 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 10 monclient: monmap: 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:18.963076+0000 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:18.963076+0000 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.018 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3232801055 0 0) 0x7fbbe4003610 con 0x7fbc000585e0 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 >> v1:10.20.193.31:6789/0 conn(0x7fbc000ba350 legacy=0x7fbc00057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 >> v1:10.20.193.21:6789/0 conn(0x7fbc000b9f80 legacy=0x7fbc00163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc000573f0 con 0x7fbc000585e0 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbbf4003170 con 0x7fbc000585e0 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbbfeffd640 10 monclient: dump: 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbc0659b640 5 monclient: authenticate success, global_id 4412 2026-02-25T15:01:19.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fbc0659b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528718891 0 0) 0x7fe6dc0b5610 con 0x7fe6dc0ba300 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 10 monclient(hunting): my global_id is 4409 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6dc168380 con 0x7fe6dc0ba300 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-a con 0x7f0d2c0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-b con 0x7f0d2c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-c con 0x7f0d2c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c163930 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c163bb0 con 0x7f0d2c0ba350 2026-02-25T15:01:19.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 1 Processor -- start 2026-02-25T15:01:19.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c163e90 con 0x7f0d2c0585e0 2026-02-25T15:01:19.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7f0d324c6640 10 monclient(hunting): authenticate will time out at 3022.554929s 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 1 -- start start 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.962+0000 7fdd6149d640 10 monclient: init 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-b con 0x7fdd5c15e1b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-a con 0x7fdd5c15e580 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-c con 0x7fdd5c083dc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c165270 con 0x7fdd5c15e580 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c05e1e0 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c161c60 con 0x7fdd5c083dc0 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7fdd6149d640 10 monclient(hunting): authenticate will time out at 3022.555657s 2026-02-25T15:01:19.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.963+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3358085913 0 0) 0x7f798c160350 con 0x7f798c0b4ba0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 >> v1:10.20.193.31:6789/0 conn(0x7f798c15d5d0 legacy=0x7f798c056d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 >> v1:10.20.193.21:6789/0 conn(0x7f798c057480 legacy=0x7f798c0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c160910 con 0x7f798c0b4ba0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7988003170 con 0x7f798c0b4ba0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f797bfff640 10 monclient: dump: 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f7993867640 5 monclient: authenticate success, global_id 4400 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f7993867640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848433200 0 0) 0x7f8078163bb0 con 0x7f80780b9f80 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 10 monclient(hunting): my global_id is 4402 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003610 con 0x7f80780b9f80 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a30003190 con 0x7f4a3c0ba350 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 4 set_mon_vals no callback set 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 1 -- 10.20.193.21:0/913223998 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4a300035d0 con 0x7f4a3c0ba350 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a40d36640 10 monclient: dump: 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 10 monclient: shutdown 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 1 -- 10.20.193.21:0/913223998 >> v1:10.20.193.21:6789/0 conn(0x7f4a3c0ba350 legacy=0x7f4a3c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 1 -- 10.20.193.21:0/913223998 shutdown_connections 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.964+0000 7f4a43fc3640 1 -- 10.20.193.21:0/913223998 >> 10.20.193.21:0/913223998 conn(0x7f4a3c0b7990 msgr2=0x7f4a3c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4293872429 0 0) 0x7f3cec003610 con 0x7f3d040ba350 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 >> v1:10.20.193.68:6789/0 conn(0x7f3d040b9f80 legacy=0x7f3d04163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 >> v1:10.20.193.21:6789/0 conn(0x7f3d040585e0 legacy=0x7f3d04166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 -- 10.20.193.21:0/913223998 shutdown_connections 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 monclient: found mon.noname-b 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040573f0 con 0x7f3d040ba350 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3cf8002df0 con 0x7f3d040ba350 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 -- 10.20.193.21:0/913223998 wait complete. 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d09012640 10 monclient: dump: 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.026 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d0c29f640 5 monclient: authenticate success, global_id 4396 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f3d0c29f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439032369 0 0) 0x7f9928129710 con 0x7f992815d440 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 10 monclient(hunting): my global_id is 4399 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98f8003610 con 0x7f992815d440 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f987c868640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f987815deb0 0x7f98780b9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40046/0 (socket says 10.20.193.21:40046) 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f987c868640 1 -- 10.20.193.21:0/667135173 learned_addr learned my addr 10.20.193.21:0/667135173 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 10 monclient: monmap: 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.027 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 librados: starting msgr at 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 librados: starting objecter 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 Processor -- start 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 -- start start 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 librados: setting wanted keys 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 1 librados: calling monclient init 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.965+0000 7f4a43fc3640 10 monclient: init 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576152161 0 0) 0x7f8078163e90 con 0x7f80780ba350 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 10 monclient(hunting): my global_id is 4415 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078163bb0 con 0x7f80780ba350 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 607022192 0 0) 0x7fe6c4003610 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 >> v1:10.20.193.68:6789/0 conn(0x7fe6dc0ba300 legacy=0x7fe6dc0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 >> v1:10.20.193.21:6789/0 conn(0x7fe6dc0b7110 legacy=0x7fe6dc1676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 monclient: found mon.noname-b 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc0b58f0 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe6cc002df0 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e127d640 10 monclient: dump: 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-c con 0x7f4a3c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-a con 0x7f4a3c0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e450a640 5 monclient: authenticate success, global_id 4393 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7fe6e450a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient(hunting): picked mon.noname-b con 0x7f4a3c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c1660a0 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c1712a0 con 0x7f4a3c0ba350 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c171580 con 0x7f4a3c0585e0 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.966+0000 7f4a43fc3640 10 monclient(hunting): authenticate will time out at 3022.558495s 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129921240 0 0) 0x7f99281299f0 con 0x7f992815d070 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): my global_id is 4418 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9928129710 con 0x7f992815d070 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7ff09b7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff09c0585e0 0x7ff09c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39530/0 (socket says 10.20.193.21:39530) 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7ff09b7fe640 1 -- 10.20.193.21:0/1783770706 learned_addr learned my addr 10.20.193.21:0/1783770706 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002875131 0 0) 0x7f992812b1a0 con 0x7f9928166f60 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 10 monclient(hunting): my global_id is 4380 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.967+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99281299f0 con 0x7f9928166f60 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013107594 0 0) 0x7f7b24002910 con 0x7f7b300b9f80 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 10 monclient(hunting): my global_id is 4383 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.968+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b1c003610 con 0x7f7b300b9f80 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f51e6478640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f51e00585e0 0x7f51e0166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40066/0 (socket says 10.20.193.21:40066) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f51e6478640 1 -- 10.20.193.21:0/3498836802 learned_addr learned my addr 10.20.193.21:0/3498836802 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f0d2bfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f0d2c0b9f80 0x7f0d2c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40072/0 (socket says 10.20.193.21:40072) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f0d2bfff640 1 -- 10.20.193.21:0/3563578439 learned_addr learned my addr 10.20.193.21:0/3563578439 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918427398 0 0) 0x7f406c163930 con 0x7f406c159a70 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 10 monclient(hunting): my global_id is 4389 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.969+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4058003610 con 0x7f406c159a70 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.970+0000 7f4a41537640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f4a3c0b9f80 0x7f4a3c172620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40084/0 (socket says 10.20.193.21:40084) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.970+0000 7f4a41537640 1 -- 10.20.193.21:0/1051023730 learned_addr learned my addr 10.20.193.21:0/1051023730 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.970+0000 7f4a2a7fc640 10 client.?.objecter ms_handle_connect 0x7f4a3c0b9f80 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.970+0000 7f4a2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647958863 0 0) 0x7f7b30163bb0 con 0x7f7b300585e0 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 10 monclient(hunting): my global_id is 4411 2026-02-25T15:01:19.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b24002910 con 0x7f7b300585e0 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.971+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4260273611 0 0) 0x7f8064003610 con 0x7f80780b9f80 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 >> v1:10.20.193.68:6789/0 conn(0x7f80780ba350 legacy=0x7f8078057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 >> v1:10.20.193.21:6789/0 conn(0x7f80780585e0 legacy=0x7f8078166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 1 monclient: found mon.noname-b 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80780573f0 con 0x7f80780b9f80 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f806c002df0 con 0x7f80780b9f80 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f8075ffb640 10 monclient: dump: 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f807d71a640 5 monclient: authenticate success, global_id 4402 2026-02-25T15:01:19.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f807d71a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 275396607 0 0) 0x7f98f8003610 con 0x7f992815d440 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f992812b1a0 con 0x7f992815d440 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9918003090 con 0x7f992815d440 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.972+0000 7f9924ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124965061 0 0) 0x7f2628163bb0 con 0x7f26280585e0 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 10 monclient(hunting): my global_id is 4408 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.975+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2610003610 con 0x7f26280585e0 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f052c003000 con 0x7f053c0ba350 2026-02-25T15:01:19.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 1 -- 10.20.193.21:0/3984957231 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f052c003440 con 0x7f053c0ba350 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f053a7fc640 10 monclient: dump: 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f0541a8a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.976+0000 7f0541a8a640 4 set_mon_vals no callback set 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 10 monclient: shutdown 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 1 -- 10.20.193.21:0/3984957231 >> v1:10.20.193.68:6789/0 conn(0x7f053c0ba350 legacy=0x7f053c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 1 -- 10.20.193.21:0/3984957231 shutdown_connections 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 1 -- 10.20.193.21:0/3984957231 >> 10.20.193.21:0/3984957231 conn(0x7f053c0b7990 msgr2=0x7f053c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 1 -- 10.20.193.21:0/3984957231 shutdown_connections 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f0541a8a640 1 -- 10.20.193.21:0/3984957231 wait complete. 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032267436 0 0) 0x7ff09c163e90 con 0x7ff09c0585e0 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 10 monclient(hunting): my global_id is 4427 2026-02-25T15:01:19.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088003610 con 0x7ff09c0585e0 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6cc003000 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 1 -- 10.20.193.21:0/922120759 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe6cc003440 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e450a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e450a640 4 set_mon_vals no callback set 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7fe6e127d640 10 monclient: dump: 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3cf8002fc0 con 0x7f3d040ba350 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 1 -- 10.20.193.21:0/3209544198 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3cf8003400 con 0x7f3d040ba350 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d09012640 10 monclient: dump: 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d0c29f640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f3d0c29f640 4 set_mon_vals no callback set 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f79880033b0 con 0x7f798c0b4ba0 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 1 -- 10.20.193.21:0/3185352424 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f79880037f0 con 0x7f798c0b4ba0 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f797bfff640 10 monclient: dump: 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f7993867640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.977+0000 7f7993867640 4 set_mon_vals no callback set 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient: monmap: 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.036 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 10 monclient: shutdown 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 10 monclient: shutdown 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 1 -- 10.20.193.21:0/3209544198 >> v1:10.20.193.31:6789/0 conn(0x7f3d040ba350 legacy=0x7f3d04057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 librados: starting msgr at 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 librados: starting objecter 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 Processor -- start 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 1 -- 10.20.193.21:0/922120759 >> v1:10.20.193.31:6789/0 conn(0x7fe6dc0b9f30 legacy=0x7fe6dc16b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 1 -- 10.20.193.21:0/922120759 shutdown_connections 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 1 -- 10.20.193.21:0/922120759 >> 10.20.193.21:0/922120759 conn(0x7fe6dc0b7990 msgr2=0x7fe6dc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 1 -- 10.20.193.21:0/3209544198 shutdown_connections 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 1 -- 10.20.193.21:0/3209544198 >> 10.20.193.21:0/3209544198 conn(0x7f3d040b7990 msgr2=0x7f3d040b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 1 -- 10.20.193.21:0/922120759 shutdown_connections 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 1 -- 10.20.193.21:0/3209544198 shutdown_connections 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 1 -- 10.20.193.21:0/3209544198 wait complete. 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 -- start start 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 librados: setting wanted keys 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 librados: calling monclient init 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient: init 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7fe6e450a640 1 -- 10.20.193.21:0/922120759 wait complete. 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 10 monclient: shutdown 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 1 -- 10.20.193.21:0/3185352424 >> v1:10.20.193.68:6789/0 conn(0x7f798c0b4ba0 legacy=0x7f798c0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 1 -- 10.20.193.21:0/3185352424 shutdown_connections 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 1 -- 10.20.193.21:0/3185352424 >> 10.20.193.21:0/3185352424 conn(0x7f798c0b4090 msgr2=0x7f798c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 1 -- 10.20.193.21:0/3185352424 shutdown_connections 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f7993867640 1 -- 10.20.193.21:0/3185352424 wait complete. 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f3d0c29f640 10 monclient: monmap: 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.038 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-a con 0x7f053c0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-b con 0x7f053c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient(hunting): picked mon.noname-c con 0x7f053c0ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c165ee0 con 0x7f053c0585e0 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c156d30 con 0x7f053c0b9f80 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053c166170 con 0x7f053c0ba350 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.978+0000 7f0541a8a640 10 monclient(hunting): authenticate will time out at 3022.570960s 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3086746017 0 0) 0x7f9928129710 con 0x7f992815d070 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98f8003610 con 0x7f992815d070 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9914002d00 con 0x7f992815d070 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f9924ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.039 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 librados: starting msgr at 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 librados: starting objecter 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 10 monclient: monmap: 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbf4003380 con 0x7fbc000585e0 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 1 -- 10.20.193.21:0/149988228 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbbf4003780 con 0x7fbc000585e0 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbbfeffd640 10 monclient: dump: 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.040 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 4 set_mon_vals no callback set 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 Processor -- start 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 10 monclient: monmap: 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 librados: starting msgr at 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 librados: starting objecter 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 Processor -- start 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309903999 0 0) 0x7f7b30163e90 con 0x7f7b300ba350 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.041 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 -- start start 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 librados: starting msgr at 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 librados: starting objecter 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 10 monclient(hunting): my global_id is 4421 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 librados: setting wanted keys 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b30163bb0 con 0x7f7b300ba350 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 1 librados: calling monclient init 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fe6e450a640 10 monclient: init 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 Processor -- start 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 -- start start 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 librados: setting wanted keys 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 1 librados: calling monclient init 2026-02-25T15:01:19.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f7993867640 10 monclient: init 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 10 monclient: shutdown 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 1 -- 10.20.193.21:0/149988228 >> v1:10.20.193.68:6789/0 conn(0x7fbc000585e0 legacy=0x7fbc00166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 -- start start 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 librados: setting wanted keys 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 librados: calling monclient init 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient: init 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-a con 0x7f3d040585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-b con 0x7f3d040b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient(hunting): picked mon.noname-c con 0x7f3d040ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d041fca90 con 0x7f3d040585e0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589854046 0 0) 0x7f98780b5e40 con 0x7f98780ba3b0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 10 monclient(hunting): my global_id is 4430 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9864003610 con 0x7f98780ba3b0 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 1 -- 10.20.193.21:0/149988228 shutdown_connections 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 1 -- 10.20.193.21:0/149988228 >> 10.20.193.21:0/149988228 conn(0x7fbc000b7990 msgr2=0x7fbc000b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d041fcd70 con 0x7f3d040b9f80 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d041fd050 con 0x7f3d040ba350 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7f3d0c29f640 10 monclient(hunting): authenticate will time out at 3022.571781s 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 1 -- 10.20.193.21:0/149988228 shutdown_connections 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.979+0000 7fbc0659b640 1 -- 10.20.193.21:0/149988228 wait complete. 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593381088 0 0) 0x7f51e0163e90 con 0x7f51e00b9f80 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): my global_id is 4436 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c8003610 con 0x7f51e00b9f80 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-a con 0x7fe6dc0b7110 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient(hunting): picked mon.noname-c con 0x7f798c057480 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient(hunting): picked mon.noname-a con 0x7f798c0b4ba0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient(hunting): picked mon.noname-b con 0x7f798c15d5d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c0b6f90 con 0x7f798c0b4ba0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c13c4f0 con 0x7f798c15d5d0 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798c13c7d0 con 0x7f798c057480 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f7993867640 10 monclient(hunting): authenticate will time out at 3022.572157s 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-c con 0x7fe6dc0b9f30 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient(hunting): picked mon.noname-b con 0x7fe6dc0ba300 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc162260 con 0x7fe6dc0b7110 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc162540 con 0x7fe6dc0ba300 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc162820 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fe6e450a640 10 monclient(hunting): authenticate will time out at 3022.572352s 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 10 monclient: monmap: 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 librados: starting msgr at 2026-02-25T15:01:19.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 librados: starting objecter 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 Processor -- start 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 -- start start 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 librados: setting wanted keys 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 1 librados: calling monclient init 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7fbc0659b640 10 monclient: init 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341799806 0 0) 0x7f0d18002910 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 10 monclient(hunting): my global_id is 4398 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d10003610 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906184504 0 0) 0x7f51dc002c90 con 0x7f51e00585e0 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 10 monclient(hunting): my global_id is 4395 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.980+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e0163e90 con 0x7f51e00585e0 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304585149 0 0) 0x7f4a3c1660a0 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 10 monclient(hunting): my global_id is 4401 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c003610 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2531346432 0 0) 0x7f98780b5880 con 0x7f987815deb0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 10 monclient(hunting): my global_id is 4392 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98780b5e40 con 0x7f987815deb0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-b con 0x7fbc000585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-c con 0x7fbc000b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient(hunting): picked mon.noname-a con 0x7fbc000ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc001fee00 con 0x7fbc000ba350 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00160320 con 0x7fbc000585e0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc00160600 con 0x7fbc000b9f80 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7fbc0659b640 10 monclient(hunting): authenticate will time out at 3022.573315s 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 719455227 0 0) 0x7f99281299f0 con 0x7f9928166f60 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9928129710 con 0x7f9928166f60 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f991c0033d0 con 0x7f9928166f60 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.981+0000 7f9924ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086660384 0 0) 0x7f7b1c003610 con 0x7f7b300b9f80 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 >> v1:10.20.193.68:6789/0 conn(0x7f7b300ba350 legacy=0x7f7b30057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 >> v1:10.20.193.31:6789/0 conn(0x7f7b300585e0 legacy=0x7f7b30166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300573f0 con 0x7f7b300b9f80 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7b24002fc0 con 0x7f7b300b9f80 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b2dffb640 10 monclient: dump: 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.048 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b35a16640 5 monclient: authenticate success, global_id 4383 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f7b35a16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456142804 0 0) 0x7f2628163e90 con 0x7f26280ba350 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 10 monclient(hunting): my global_id is 4424 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2628163bb0 con 0x7f26280ba350 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3450721146 0 0) 0x7f4058003610 con 0x7f406c159a70 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7fdd5affd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fdd5c15e1b0 0x7fdd5c0b4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46094/0 (socket says 10.20.193.21:46094) 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7fdd5affd640 1 -- 10.20.193.21:0/1298774494 learned_addr learned my addr 10.20.193.21:0/1298774494 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 >> v1:10.20.193.68:6789/0 conn(0x7f406c058070 legacy=0x7f406c058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 >> v1:10.20.193.31:6789/0 conn(0x7f406c159e40 legacy=0x7f406c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406c057590 con 0x7f406c159a70 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4060002df0 con 0x7f406c159a70 2026-02-25T15:01:19.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4069ffb640 10 monclient: dump: 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4071945640 5 monclient: authenticate success, global_id 4389 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.982+0000 7f4071945640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f4a2a7fc640 10 client.?.objecter ms_handle_connect 0x7f4a3c0ba350 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f4a2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849862866 0 0) 0x7f0d2c163e90 con 0x7f0d2c0585e0 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 10 monclient(hunting): my global_id is 4439 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.983+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d18002910 con 0x7f0d2c0585e0 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530434901 0 0) 0x7f98780b5b60 con 0x7f987815e280 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 10 monclient(hunting): my global_id is 4414 2026-02-25T15:01:19.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98780b5880 con 0x7f987815e280 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f053bfff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f053c0ba350 0x7f053c1645a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39580/0 (socket says 10.20.193.21:39580) 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.988+0000 7f053bfff640 1 -- 10.20.193.21:0/2997712336 learned_addr learned my addr 10.20.193.21:0/2997712336 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664003304 0 0) 0x7f0d2c163bb0 con 0x7f0d2c0ba350 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 10 monclient(hunting): my global_id is 4426 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d2c163e90 con 0x7f0d2c0ba350 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1101696585 0 0) 0x7f2610003610 con 0x7f26280585e0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 >> v1:10.20.193.68:6789/0 conn(0x7f26280ba350 legacy=0x7f2628057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 >> v1:10.20.193.21:6789/0 conn(0x7f26280b9f80 legacy=0x7f2628163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 monclient: found mon.noname-b 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280573f0 con 0x7f26280585e0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2624003170 con 0x7f26280585e0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f262d191640 10 monclient: dump: 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.051 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f263041e640 5 monclient: authenticate success, global_id 4408 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f263041e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3785625314 0 0) 0x7f992812b1a0 con 0x7f992815d440 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 >> v1:10.20.193.68:6789/0 conn(0x7f992815d070 legacy=0x7f992812bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 >> v1:10.20.193.21:6789/0 conn(0x7f9928166f60 legacy=0x7f992815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 1 monclient: found mon.b 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9928129cd0 con 0x7f992815d440 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f9924ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 5 monclient: authenticate success, global_id 4399 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 10 monclient: _renew_subs 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9928129fb0 con 0x7f992815d440 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 10 monclient: _renew_subs 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f992812a570 con 0x7f992815d440 2026-02-25T15:01:19.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f992e85b640 1 librados: init done 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 453924826 0 0) 0x7f51e0163e90 con 0x7f51e00585e0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 >> v1:10.20.193.68:6789/0 conn(0x7f51e00b9f80 legacy=0x7f51e0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 >> v1:10.20.193.31:6789/0 conn(0x7f51e00ba350 legacy=0x7f51e0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e00573f0 con 0x7f51e00585e0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f51dc003340 con 0x7f51e00585e0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e4c75640 10 monclient: dump: 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e7f02640 5 monclient: authenticate success, global_id 4395 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.989+0000 7f51e7f02640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 10 client.4399.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 15 client.4399.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 20 client.4399.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.990+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f99280531e0 con 0x7f992815d440 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 client.?.objecter ms_handle_connect 0x7f4a3c0585e0 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1197461397 0 0) 0x7f4a0c003610 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a3c1660a0 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4a30003430 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 monclient(hunting): dump: 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f4a2a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f0517fff640 10 client.?.objecter ms_handle_connect 0x7f053c0ba350 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f0517fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f806c003000 con 0x7f80780b9f80 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 1 -- 10.20.193.21:0/2557427976 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f806c003440 con 0x7f80780b9f80 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f8075ffb640 10 monclient: dump: 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f807d71a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f807d71a640 4 set_mon_vals no callback set 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f0517fff640 10 client.?.objecter ms_handle_connect 0x7f053c0b9f80 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.991+0000 7f0517fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540568304 0 0) 0x7ff09c163bb0 con 0x7ff09c0ba350 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 10 monclient(hunting): my global_id is 4423 2026-02-25T15:01:19.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c163e90 con 0x7ff09c0ba350 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074908638 0 0) 0x7f4a3c1712a0 con 0x7f4a3c0ba350 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 10 monclient(hunting): my global_id is 4429 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c003610 con 0x7f4a3c0ba350 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392791225 0 0) 0x7fdd5c05e1e0 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 10 monclient(hunting): my global_id is 4432 2026-02-25T15:01:19.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd48003610 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 10 monclient: shutdown 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 1 -- 10.20.193.21:0/2557427976 >> v1:10.20.193.31:6789/0 conn(0x7f80780b9f80 legacy=0x7f8078163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 1 -- 10.20.193.21:0/2557427976 shutdown_connections 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 1 -- 10.20.193.21:0/2557427976 >> 10.20.193.21:0/2557427976 conn(0x7f80780b7990 msgr2=0x7f80780b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 1 -- 10.20.193.21:0/2557427976 shutdown_connections 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 1 -- 10.20.193.21:0/2557427976 wait complete. 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fbbfffff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fbc000585e0 0x7fbc0015daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46172/0 (socket says 10.20.193.21:46172) 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fbbfffff640 1 -- 10.20.193.21:0/3838302500 learned_addr learned my addr 10.20.193.21:0/3838302500 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fe6e2a80640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe6dc0ba300 0x7fe6dc166380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46158/0 (socket says 10.20.193.21:46158) 2026-02-25T15:01:19.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7fe6e2a80640 1 -- 10.20.193.21:0/3497067773 learned_addr learned my addr 10.20.193.21:0/3497067773 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.992+0000 7f807d71a640 10 monclient: monmap: 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 librados: starting msgr at 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 librados: starting objecter 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 Processor -- start 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 -- start start 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 librados: setting wanted keys 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 librados: calling monclient init 2026-02-25T15:01:19.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient: init 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f3d09813640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3d040b9f80 0x7f3d04155880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46132/0 (socket says 10.20.193.21:46132) 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f3d09813640 1 -- 10.20.193.21:0/1062810460 learned_addr learned my addr 10.20.193.21:0/1062810460 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7fbbfcff9640 10 client.?.objecter ms_handle_connect 0x7fbc000585e0 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7fbbfcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-a con 0x7f80780585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-b con 0x7f80780b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient(hunting): picked mon.noname-c con 0x7f80780ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80781fe240 con 0x7f80780585e0 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078164af0 con 0x7f80780b9f80 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078164dd0 con 0x7f80780ba350 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f807d71a640 10 monclient(hunting): authenticate will time out at 3022.585737s 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7fe6c2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6dc0ba300 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7fe6c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f3ceaffd640 10 client.?.objecter ms_handle_connect 0x7f3d040b9f80 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.993+0000 7f3ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 20281066 0 0) 0x7f98780b5e40 con 0x7f987815deb0 2026-02-25T15:01:19.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 >> v1:10.20.193.68:6789/0 conn(0x7f98780ba3b0 legacy=0x7f98780ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 >> v1:10.20.193.31:6789/0 conn(0x7f987815e280 legacy=0x7f98780ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98780b6120 con 0x7f987815deb0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9868002df0 con 0x7f987815deb0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f986f7fe640 10 monclient: dump: 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f987eaf3640 5 monclient: authenticate success, global_id 4392 2026-02-25T15:01:19.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f987eaf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3903383804 0 0) 0x7ff088003610 con 0x7ff09c0585e0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 >> v1:10.20.193.31:6789/0 conn(0x7ff09c0ba350 legacy=0x7ff09c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 >> v1:10.20.193.21:6789/0 conn(0x7ff09c0b9f80 legacy=0x7ff09c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0573f0 con 0x7ff09c0585e0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff08c003170 con 0x7ff09c0585e0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff099ffb640 10 monclient: dump: 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.062 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff0a192e640 5 monclient: authenticate success, global_id 4427 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7ff0a192e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f0517fff640 10 client.?.objecter ms_handle_connect 0x7f053c0585e0 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f0517fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f79915dc640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f798c057480 0x7f798c0b6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39602/0 (socket says 10.20.193.21:39602) 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.994+0000 7f79915dc640 1 -- 10.20.193.21:0/1280775389 learned_addr learned my addr 10.20.193.21:0/1280775389 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.995+0000 7f7979ffb640 10 client.?.objecter ms_handle_connect 0x7f798c057480 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.995+0000 7f7979ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.995+0000 7f7979ffb640 10 client.?.objecter ms_handle_connect 0x7f798c0b4ba0 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.995+0000 7f7979ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.996+0000 7f3ceaffd640 10 client.?.objecter ms_handle_connect 0x7f3d040ba350 2026-02-25T15:01:19.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.996+0000 7f3ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fe6c2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6dc0b7110 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fe6c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463764838 0 0) 0x7fdd5c161c60 con 0x7fdd5c083dc0 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 10 monclient(hunting): my global_id is 4442 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.997+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5c05e1e0 con 0x7fdd5c083dc0 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772883345 0 0) 0x7f053c166170 con 0x7f053c0ba350 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 10 monclient(hunting): my global_id is 4445 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f050c003610 con 0x7f053c0ba350 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7fe6c2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6dc0b9f30 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7fe6c2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7fbbfcff9640 10 client.?.objecter ms_handle_connect 0x7fbc000b9f80 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:18.998+0000 7fbbfcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 794842267 0 0) 0x7f0d10003610 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 >> v1:10.20.193.68:6789/0 conn(0x7f0d2c0585e0 legacy=0x7f0d2c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 >> v1:10.20.193.31:6789/0 conn(0x7f0d2c0ba350 legacy=0x7f0d2c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c0573f0 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d18002fc0 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d2affd640 10 monclient: dump: 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d324c6640 5 monclient: authenticate success, global_id 4398 2026-02-25T15:01:19.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.000+0000 7f0d324c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff08c003380 con 0x7ff09c0585e0 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 1 -- 10.20.193.21:0/1783770706 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff08c0037c0 con 0x7ff09c0585e0 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff099ffb640 10 monclient: dump: 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff0a192e640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.002+0000 7ff0a192e640 4 set_mon_vals no callback set 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 10 monclient: shutdown 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 1 -- 10.20.193.21:0/1783770706 >> v1:10.20.193.68:6789/0 conn(0x7ff09c0585e0 legacy=0x7ff09c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 1 -- 10.20.193.21:0/1783770706 shutdown_connections 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 1 -- 10.20.193.21:0/1783770706 >> 10.20.193.21:0/1783770706 conn(0x7ff09c0b7990 msgr2=0x7ff09c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 1 -- 10.20.193.21:0/1783770706 shutdown_connections 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.003+0000 7ff0a192e640 1 -- 10.20.193.21:0/1783770706 wait complete. 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 client.?.objecter ms_handle_connect 0x7f798c15d5d0 2026-02-25T15:01:19.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 10 monclient: monmap: 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356564489 0 0) 0x7fdd5c05e1e0 con 0x7fdd5c083dc0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 >> v1:10.20.193.31:6789/0 conn(0x7fdd5c15e1b0 legacy=0x7fdd5c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 >> v1:10.20.193.21:6789/0 conn(0x7fdd5c15e580 legacy=0x7fdd5c164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c0b3450 con 0x7fdd5c083dc0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdd4c003170 con 0x7fdd5c083dc0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 librados: starting msgr at 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 librados: starting objecter 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd59ffb640 10 monclient: dump: 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd6149d640 5 monclient: authenticate success, global_id 4442 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fdd6149d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211063873 0 0) 0x7f798c0b6f90 con 0x7f798c0b4ba0 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 Processor -- start 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 10 monclient(hunting): my global_id is 4407 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003610 con 0x7f798c0b4ba0 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896129986 0 0) 0x7fe6dc162540 con 0x7fe6dc0ba300 2026-02-25T15:01:19.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 -- start start 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 librados: setting wanted keys 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 1 librados: calling monclient init 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 10 monclient(hunting): my global_id is 4444 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7ff0a192e640 10 monclient: init 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.004+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ac003610 con 0x7fe6dc0ba300 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2053356323 0 0) 0x7f4a0c003610 con 0x7f4a3c0ba350 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a3c1712a0 con 0x7f4a3c0ba350 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4a38003400 con 0x7f4a3c0ba350 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7f4a2a7fc640 10 monclient(hunting): dump: 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.069 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-c con 0x7ff09c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-a con 0x7ff09c0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient(hunting): picked mon.noname-b con 0x7ff09c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c1fe2a0 con 0x7ff09c0b9f80 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c1fd160 con 0x7ff09c0ba350 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c1fd440 con 0x7ff09c0585e0 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.005+0000 7ff0a192e640 10 monclient(hunting): authenticate will time out at 3022.597566s 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562654284 0 0) 0x7f4a3c171580 con 0x7f4a3c0585e0 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 10 monclient(hunting): my global_id is 4448 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c003610 con 0x7f4a3c0585e0 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251915171 0 0) 0x7f3d041fd050 con 0x7f3d040ba350 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 10 monclient(hunting): my global_id is 4454 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd4003610 con 0x7f3d040ba350 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955663006 0 0) 0x7fe6dc162820 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 10 monclient(hunting): my global_id is 4460 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b24003190 con 0x7f7b300b9f80 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 1 -- 10.20.193.21:0/55168210 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7b24004990 con 0x7f7b300b9f80 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b2dffb640 10 monclient: dump: 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.071 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6dc162540 con 0x7fe6dc0b9f30 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b35a16640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7b35a16640 4 set_mon_vals no callback set 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646320159 0 0) 0x7f798c13c7d0 con 0x7f798c057480 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 10 monclient(hunting): my global_id is 4451 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.006+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f798c0b6f90 con 0x7f798c057480 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234268375 0 0) 0x7fbc00160600 con 0x7fbc000b9f80 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 10 monclient(hunting): my global_id is 4457 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd0003610 con 0x7fbc000b9f80 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51dc003550 con 0x7f51e00585e0 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 1 -- 10.20.193.21:0/3498836802 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f51dc004d10 con 0x7f51e00585e0 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e4c75640 10 monclient: dump: 2026-02-25T15:01:19.072 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e7f02640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e7f02640 4 set_mon_vals no callback set 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 10 monclient: shutdown 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 1 -- 10.20.193.21:0/55168210 >> v1:10.20.193.21:6789/0 conn(0x7f7b300b9f80 legacy=0x7f7b30163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 365312606 0 0) 0x7f050c003610 con 0x7f053c0ba350 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3710122476 0 0) 0x7f4a3c1660a0 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 >> v1:10.20.193.68:6789/0 conn(0x7f4a3c0585e0 legacy=0x7f4a3c165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 >> v1:10.20.193.31:6789/0 conn(0x7f4a3c0ba350 legacy=0x7f4a3c173320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 1 monclient: found mon.a 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f053c166170 con 0x7f053c0ba350 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0530003460 con 0x7f053c0ba350 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.073 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c171860 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 1 -- 10.20.193.21:0/55168210 shutdown_connections 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 1 -- 10.20.193.21:0/55168210 >> 10.20.193.21:0/55168210 conn(0x7f7b300b7990 msgr2=0x7f7b300b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209863115 0 0) 0x7f053c165ee0 con 0x7f053c0585e0 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.074 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 5 monclient: authenticate success, global_id 4401 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 10 monclient: _renew_subs 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 10 monclient(hunting): my global_id is 4404 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f050c003610 con 0x7f053c0585e0 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c171b40 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 10 monclient: _renew_subs 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a3c172100 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f4a43fc3640 1 librados: init done 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 1 -- 10.20.193.21:0/55168210 shutdown_connections 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e7f02640 10 monclient: shutdown 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e7f02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f51e7f02640 1 -- 10.20.193.21:0/3498836802 >> v1:10.20.193.21:6789/0 conn(0x7f51e00585e0 legacy=0x7f51e0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f7b35a16640 1 -- 10.20.193.21:0/55168210 wait complete. 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f80777fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f80780ba350 0x7f80781fe4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39632/0 (socket says 10.20.193.21:39632) 2026-02-25T15:01:19.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7f80777fe640 1 -- 10.20.193.21:0/467286427 learned_addr learned my addr 10.20.193.21:0/467286427 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699862892 0 0) 0x7fe6dc162260 con 0x7fe6dc0b7110 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 10 monclient(hunting): my global_id is 4410 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.007+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6dc162820 con 0x7fe6dc0b7110 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 10 client.4401.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 15 client.4401.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 20 client.4401.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4a3c15b450 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 10 monclient: monmap: 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f80577fe640 10 client.?.objecter ms_handle_connect 0x7f80780ba350 2026-02-25T15:01:19.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f80577fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 1 -- 10.20.193.21:0/3498836802 shutdown_connections 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 1 -- 10.20.193.21:0/3498836802 >> 10.20.193.21:0/3498836802 conn(0x7f51e00b7990 msgr2=0x7f51e00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 1 -- 10.20.193.21:0/3498836802 shutdown_connections 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 librados: starting msgr at 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 librados: starting objecter 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 1 -- 10.20.193.21:0/3498836802 wait complete. 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9868002fc0 con 0x7f987815deb0 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 1 -- 10.20.193.21:0/667135173 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9868003400 con 0x7f987815deb0 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f986f7fe640 10 monclient: dump: 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f987eaf3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f987eaf3640 4 set_mon_vals no callback set 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 Processor -- start 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 -- start start 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 librados: setting wanted keys 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 1 librados: calling monclient init 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f7b35a16640 10 monclient: init 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f3ceaffd640 10 client.?.objecter ms_handle_connect 0x7f3d040585e0 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f3ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.008+0000 7f51e7f02640 10 monclient: monmap: 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 10 monclient: shutdown 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 -- 10.20.193.21:0/667135173 >> v1:10.20.193.21:6789/0 conn(0x7f987815deb0 legacy=0x7f98780b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 -- 10.20.193.21:0/667135173 shutdown_connections 2026-02-25T15:01:19.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 -- 10.20.193.21:0/667135173 >> 10.20.193.21:0/667135173 conn(0x7f98780b7990 msgr2=0x7f98780b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 -- 10.20.193.21:0/667135173 shutdown_connections 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-c con 0x7f7b300585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-a con 0x7f7b300b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient(hunting): picked mon.noname-b con 0x7f7b300ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300b4ea0 con 0x7f7b300b9f80 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300b23b0 con 0x7f7b300ba350 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300b2690 con 0x7f7b300585e0 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f7b35a16640 10 monclient(hunting): authenticate will time out at 3022.601209s 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 librados: starting msgr at 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 librados: starting objecter 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99280531e0 con 0x7f992815d440 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f99180038a0 con 0x7f992815d440 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f99267fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f9924ff9640 10 monclient: dump: 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 -- 10.20.193.21:0/667135173 wait complete. 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 Processor -- start 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 -- start start 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 librados: setting wanted keys 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 1 librados: calling monclient init 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 10 monclient: init 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4060003000 con 0x7f406c159a70 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 1 -- 10.20.193.21:0/404877026 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4060003400 con 0x7f406c159a70 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4069ffb640 10 monclient: dump: 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.080 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4071945640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f4071945640 4 set_mon_vals no callback set 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 10 monclient: monmap: 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7fbbfcff9640 10 client.?.objecter ms_handle_connect 0x7fbc000ba350 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7fbbfcff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d18003190 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 1 -- 10.20.193.21:0/3563578439 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d18004990 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-b con 0x7f51e00585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 librados: starting msgr at 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 1 librados: starting objecter 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d2affd640 10 monclient: dump: 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d324c6640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f0d324c6640 4 set_mon_vals no callback set 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f987eaf3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 Processor -- start 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 -- start start 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 librados: setting wanted keys 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 librados: calling monclient init 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient: init 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 10 monclient: shutdown 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 -- 10.20.193.21:0/404877026 >> v1:10.20.193.21:6789/0 conn(0x7f406c159a70 legacy=0x7f406c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.009+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-c con 0x7f51e00b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 10 monclient(hunting): picked mon.noname-a con 0x7f51e00ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e00b7060 con 0x7f51e00ba350 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e01614a0 con 0x7f51e00585e0 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e0161780 con 0x7f51e00b9f80 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f51e7f02640 10 monclient(hunting): authenticate will time out at 3022.602118s 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f991801cd80 con 0x7f992815d440 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 -- 10.20.193.21:0/404877026 shutdown_connections 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 -- 10.20.193.21:0/404877026 >> 10.20.193.21:0/404877026 conn(0x7f406c0b7780 msgr2=0x7f406c0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 -- 10.20.193.21:0/404877026 shutdown_connections 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 -- 10.20.193.21:0/404877026 wait complete. 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 10 monclient: shutdown 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 1 -- 10.20.193.21:0/3563578439 >> v1:10.20.193.21:6789/0 conn(0x7f0d2c0b9f80 legacy=0x7f0d2c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 1 -- 10.20.193.21:0/3563578439 shutdown_connections 2026-02-25T15:01:19.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 1 -- 10.20.193.21:0/3563578439 >> 10.20.193.21:0/3563578439 conn(0x7f0d2c0b7990 msgr2=0x7f0d2c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-a con 0x7f98780ba3b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 1 -- 10.20.193.21:0/3563578439 shutdown_connections 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-c con 0x7f987815deb0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient(hunting): picked mon.noname-b con 0x7f987815e280 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9878137b00 con 0x7f98780ba3b0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 1 -- 10.20.193.21:0/3563578439 wait complete. 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9878137de0 con 0x7f987815e280 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98781380c0 con 0x7f987815deb0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f987eaf3640 10 monclient(hunting): authenticate will time out at 3022.602508s 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 10 monclient: monmap: 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.084 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd4c003380 con 0x7fdd5c083dc0 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 1 -- 10.20.193.21:0/1298774494 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdd4c0037c0 con 0x7fdd5c083dc0 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd59ffb640 10 monclient: dump: 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd6149d640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7fdd6149d640 4 set_mon_vals no callback set 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f9927fff640 10 monclient: get_auth_request con 0x7f98f807a040 auth_method 0 2026-02-25T15:01:19.085 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 librados: starting msgr at 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f4071945640 1 librados: starting objecter 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.010+0000 7f0d324c6640 10 monclient: monmap: 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f9924ff9640 10 client.4399.objecter ms_handle_connect 0x7f98f807a040 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 Processor -- start 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 -- start start 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 librados: setting wanted keys 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 librados: calling monclient init 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient: init 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 librados: starting msgr at 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 librados: starting objecter 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 Processor -- start 2026-02-25T15:01:19.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 -- start start 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 librados: setting wanted keys 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 librados: calling monclient init 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient: init 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 10 monclient: shutdown 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 1 -- 10.20.193.21:0/1298774494 >> v1:10.20.193.68:6789/0 conn(0x7fdd5c083dc0 legacy=0x7fdd5c164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 1 -- 10.20.193.21:0/1298774494 shutdown_connections 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 1 -- 10.20.193.21:0/1298774494 >> 10.20.193.21:0/1298774494 conn(0x7fdd5c0b5300 msgr2=0x7fdd5c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 1 -- 10.20.193.21:0/1298774494 shutdown_connections 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient(hunting): picked mon.noname-c con 0x7f406c058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient(hunting): picked mon.noname-b con 0x7f406c159a70 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient(hunting): picked mon.noname-a con 0x7f406c159e40 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c166030 con 0x7f406c159e40 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c1395b0 con 0x7f406c159a70 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406c139890 con 0x7f406c058070 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f4071945640 10 monclient(hunting): authenticate will time out at 3022.603700s 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-a con 0x7f0d2c0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-c con 0x7f0d2c0b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient(hunting): picked mon.noname-b con 0x7f0d2c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0b4f10 con 0x7f0d2c0585e0 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0b2c80 con 0x7f0d2c0ba350 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2c0b3480 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7f0d324c6640 10 monclient(hunting): authenticate will time out at 3022.603730s 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.011+0000 7fdd6149d640 1 -- 10.20.193.21:0/1298774494 wait complete. 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 10 monclient: monmap: 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.088 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 librados: starting msgr at 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 librados: starting objecter 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 Processor -- start 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 -- start start 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 librados: setting wanted keys 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 1 librados: calling monclient init 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.012+0000 7fdd6149d640 10 monclient: init 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-c con 0x7fdd5c083dc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-a con 0x7fdd5c15e1b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient(hunting): picked mon.noname-b con 0x7fdd5c15e580 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c1fedb0 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0b1850 con 0x7fdd5c15e580 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5c0b1b30 con 0x7fdd5c083dc0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.013+0000 7fdd6149d640 10 monclient(hunting): authenticate will time out at 3022.605559s 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f9918094750 con 0x7f992815d440 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 10 client.4399.objecter ms_dispatch2 0x7f9928000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 3 client.4399.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 3 client.4399.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 10 client.4399.objecter checking command 1 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter _get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 15 client.4399.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter _get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 15 client.4399.objecter _session_command_op_assign 0 1 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 4 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 10 client.4399.objecter _send_command 1 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.21:6804/2253484549 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98f80c5170 con 0x7f98f80a3570 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f9924ff9640 20 client.4399.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.014+0000 7f992cdd1640 10 monclient: get_auth_request con 0x7f98f80a3570 auth_method 0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.015+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f991805d780 con 0x7f992815d440 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.015+0000 7f9924ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.015+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 532750098 0 0) 0x7f053c166170 con 0x7f053c0ba350 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 >> v1:10.20.193.31:6789/0 conn(0x7f053c0b9f80 legacy=0x7f053c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 >> v1:10.20.193.21:6789/0 conn(0x7f053c0585e0 legacy=0x7f053c1657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 1 monclient: found mon.c 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f053c166450 con 0x7f053c0ba350 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0517fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 5 monclient: authenticate success, global_id 4445 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 monclient: _renew_subs 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f053c1fb2e0 con 0x7f053c0ba350 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 client.4445.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 monclient: _renew_subs 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f053c1fb8a0 con 0x7f053c0ba350 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 1 librados: init done 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f9924ff9640 10 client.4399.objecter ms_handle_connect 0x7f98f80a3570 2026-02-25T15:01:19.090 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 client.4445.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 15 client.4445.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 20 client.4445.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 client.4445.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f053c0b96a0 con 0x7f053c0ba350 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2106299022 0 0) 0x7f3cd4003610 con 0x7f3d040ba350 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d041fd050 con 0x7f3d040ba350 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d000035e0 con 0x7f3d040ba350 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.016+0000 7f3ceaffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1547035121 0 0) 0x7f795c003610 con 0x7f798c0b4ba0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f798c13c7d0 con 0x7f798c0b4ba0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7980003060 con 0x7f798c0b4ba0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.091 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.020+0000 7f7979ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4139404684 0 0) 0x7fe6ac003610 con 0x7fe6dc0ba300 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6dc162260 con 0x7fe6dc0ba300 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe6d80033d0 con 0x7fe6dc0ba300 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fe6c2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043249325 0 0) 0x7fbc00160320 con 0x7fbc000585e0 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.092 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 10 monclient(hunting): my global_id is 4441 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.021+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc00160600 con 0x7fbc000585e0 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.022+0000 7ff09b7fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7ff09c0ba350 0x7ff09c161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46192/0 (socket says 10.20.193.21:46192) 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.022+0000 7ff09b7fe640 1 -- 10.20.193.21:0/3640225429 learned_addr learned my addr 10.20.193.21:0/3640225429 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.023+0000 7ff073fff640 10 client.?.objecter ms_handle_connect 0x7ff09c0585e0 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.023+0000 7ff073fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.023+0000 7f80577fe640 10 client.?.objecter ms_handle_connect 0x7f80780b9f80 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.023+0000 7f80577fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a3c15b450 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4a30003a20 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 10 monclient: dump: 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.093 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2bfff640 4 set_mon_vals no callback set 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f80577fe640 10 client.?.objecter ms_handle_connect 0x7f80780585e0 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f80577fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.024+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f4a30003c30 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150594842 0 0) 0x7f3d041fca90 con 0x7f3d040585e0 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 10 monclient(hunting): my global_id is 4416 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd4003610 con 0x7f3d040585e0 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476852115 0 0) 0x7fbc001fee00 con 0x7fbc000ba350 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 10 monclient(hunting): my global_id is 4419 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc00160320 con 0x7fbc000ba350 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f4a41d38640 10 monclient: get_auth_request con 0x7f4a0c07a260 auth_method 0 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f7b2e7fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f7b300b9f80 0x7f7b301fc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:40152/0 (socket says 10.20.193.21:40152) 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f7b2e7fc640 1 -- 10.20.193.21:0/722344640 learned_addr learned my addr 10.20.193.21:0/722344640 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7ff073fff640 10 client.?.objecter ms_handle_connect 0x7ff09c0ba350 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7ff073fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.025+0000 7f4a2a7fc640 10 client.4401.objecter ms_handle_connect 0x7f4a0c07a260 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374495405 0 0) 0x7f3d041fcd70 con 0x7f3d040b9f80 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 10 monclient(hunting): my global_id is 4438 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d041fca90 con 0x7f3d040b9f80 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f987d069640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f987815e280 0x7f9878149f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46222/0 (socket says 10.20.193.21:46222) 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.026+0000 7f987d069640 1 -- 10.20.193.21:0/3835944837 learned_addr learned my addr 10.20.193.21:0/3835944837 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219517028 0 0) 0x7f798c13c4f0 con 0x7f798c15d5d0 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 10 monclient(hunting): my global_id is 4447 2026-02-25T15:01:19.095 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003610 con 0x7f798c15d5d0 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f986d7fa640 10 client.?.objecter ms_handle_connect 0x7f987815e280 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.027+0000 7f986d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f4a30095bd0 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 10 client.4401.objecter ms_dispatch2 0x7f4a3c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 3 client.4401.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 3 client.4401.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 10 client.4401.objecter checking command 1 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter _get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 15 client.4401.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter _get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 15 client.4401.objecter _session_command_op_assign 1 1 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 4 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 10 client.4401.objecter _send_command 1 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.31:6808/1809978267 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a30003190 con 0x7f4a0c0a3790 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 20 client.4401.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f4a3005ec00 con 0x7f4a3c0b9f80 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.028+0000 7f4a2a7fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f7b07fff640 10 client.?.objecter ms_handle_connect 0x7f7b300b9f80 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f7b07fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f4a42539640 10 monclient: get_auth_request con 0x7f4a0c0a3790 auth_method 0 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f7b07fff640 10 client.?.objecter ms_handle_connect 0x7f7b300585e0 2026-02-25T15:01:19.097 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f7b07fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.098 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089908863 0 0) 0x7f8078164dd0 con 0x7f80780ba350 2026-02-25T15:01:19.098 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.098 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.099 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.099 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 10 monclient(hunting): my global_id is 4463 2026-02-25T15:01:19.099 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8044003610 con 0x7f80780ba350 2026-02-25T15:01:19.099 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7ff073fff640 10 client.?.objecter ms_handle_connect 0x7ff09c0b9f80 2026-02-25T15:01:19.099 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7ff073fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f406affd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f406c058070 0x7f406c165920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39678/0 (socket says 10.20.193.21:39678) 2026-02-25T15:01:19.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f406affd640 1 -- 10.20.193.21:0/2510164016 learned_addr learned my addr 10.20.193.21:0/2510164016 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f51e5476640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f51e00b9f80 0x7f51e00b6950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:39664/0 (socket says 10.20.193.21:39664) 2026-02-25T15:01:19.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.029+0000 7f51e5476640 1 -- 10.20.193.21:0/1656549849 learned_addr learned my addr 10.20.193.21:0/1656549849 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.030+0000 7f4a2a7fc640 10 client.4401.objecter ms_handle_connect 0x7f4a0c0a3790 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.030+0000 7f986d7fa640 10 client.?.objecter ms_handle_connect 0x7f987815deb0 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.030+0000 7f986d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f4043fff640 10 client.?.objecter ms_handle_connect 0x7f406c058070 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f4043fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f51ce7fc640 10 client.?.objecter ms_handle_connect 0x7f51e00b9f80 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f51ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2624003380 con 0x7f26280585e0 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 1 -- 10.20.193.21:0/1601072104 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f26240037c0 con 0x7f26280585e0 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f262d191640 10 monclient: dump: 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.101 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f263041e640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f263041e640 4 set_mon_vals no callback set 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7fdd5b7fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fdd5c15e580 0x7fdd5c15a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46252/0 (socket says 10.20.193.21:46252) 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7fdd5b7fe640 1 -- 10.20.193.21:0/2667080053 learned_addr learned my addr 10.20.193.21:0/2667080053 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f263041e640 10 monclient: shutdown 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f263041e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.031+0000 7f263041e640 1 -- 10.20.193.21:0/1601072104 >> v1:10.20.193.31:6789/0 conn(0x7f26280585e0 legacy=0x7f2628166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 -- 10.20.193.21:0/1601072104 shutdown_connections 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 -- 10.20.193.21:0/1601072104 >> 10.20.193.21:0/1601072104 conn(0x7f26280b7990 msgr2=0x7f26280b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 -- 10.20.193.21:0/1601072104 shutdown_connections 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 -- 10.20.193.21:0/1601072104 wait complete. 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f7b07fff640 10 client.?.objecter ms_handle_connect 0x7f7b300ba350 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 10 monclient: monmap: 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.102 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f7b07fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7fdd3b7fe640 10 client.?.objecter ms_handle_connect 0x7fdd5c15e580 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7fdd3b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 librados: starting msgr at 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 librados: starting objecter 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 Processor -- start 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 -- start start 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 librados: setting wanted keys 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 1 librados: calling monclient init 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f263041e640 10 monclient: init 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f0d30a3c640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f0d2c0ba350 0x7f0d2c165df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46250/0 (socket says 10.20.193.21:46250) 2026-02-25T15:01:19.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.032+0000 7f0d30a3c640 1 -- 10.20.193.21:0/646505531 learned_addr learned my addr 10.20.193.21:0/646505531 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3089797299 0 0) 0x7f798c0b6f90 con 0x7f798c057480 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f798c13c4f0 con 0x7f798c057480 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f797c003050 con 0x7f798c057480 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f7979ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f0d28ff9640 10 client.?.objecter ms_handle_connect 0x7f0d2c0ba350 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f0d28ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient(hunting): picked mon.noname-a con 0x7f26280585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient(hunting): picked mon.noname-b con 0x7f26280b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient(hunting): picked mon.noname-c con 0x7f26280ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280b2040 con 0x7f26280585e0 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2908598856 0 0) 0x7fbbd0003610 con 0x7fbc000b9f80 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc001fee00 con 0x7fbc000b9f80 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbbf0002f70 con 0x7fbc000b9f80 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7fbbfcff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280b2320 con 0x7f26280b9f80 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26280b2600 con 0x7f26280ba350 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.033+0000 7f263041e640 10 monclient(hunting): authenticate will time out at 3022.625626s 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7f51ce7fc640 10 client.?.objecter ms_handle_connect 0x7f51e00585e0 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7f51ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7f0d28ff9640 10 client.?.objecter ms_handle_connect 0x7f0d2c0b9f80 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7f0d28ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7fdd3b7fe640 10 client.?.objecter ms_handle_connect 0x7fdd5c083dc0 2026-02-25T15:01:19.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.035+0000 7fdd3b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 599903264 0 0) 0x7fe6dc162260 con 0x7fe6dc0ba300 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 >> v1:10.20.193.68:6789/0 conn(0x7fe6dc0b9f30 legacy=0x7fe6dc1635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 >> v1:10.20.193.21:6789/0 conn(0x7fe6dc0b7110 legacy=0x7fe6dc15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 1 monclient: found mon.b 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc162b00 con 0x7fe6dc0ba300 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 5 monclient: authenticate success, global_id 4444 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 10 monclient: _renew_subs 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6dc162de0 con 0x7fe6dc0ba300 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 10 monclient: _renew_subs 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6dc163cf0 con 0x7fe6dc0ba300 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.036+0000 7fe6e450a640 1 librados: init done 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 10 client.4444.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 15 client.4444.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 20 client.4444.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe6dc202d90 con 0x7fe6dc0ba300 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955797161 0 0) 0x7ff09c1fd160 con 0x7ff09c0ba350 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 10 monclient(hunting): my global_id is 4450 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.037+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff06c003610 con 0x7ff09c0ba350 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f4043fff640 10 client.?.objecter ms_handle_connect 0x7f406c159a70 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f4043fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957613500 0 0) 0x7f9878137de0 con 0x7f987815e280 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 10 monclient(hunting): my global_id is 4456 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9848003610 con 0x7f987815e280 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== osd.0 v1:10.20.193.21:6804/2253484549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f98f80c5170 con 0x7f98f80a3570 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f9924ff9640 10 client.4399.objecter ms_dispatch2 0x7f9928000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f9924ff9640 10 client.4399.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f9924ff9640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 4 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.038+0000 7f9924ff9640 15 client.4399.objecter _session_command_op_remove 0 1 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314621697 0 0) 0x7f0d2c0b2c80 con 0x7f0d2c0ba350 2026-02-25T15:01:19.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 10 monclient(hunting): my global_id is 4465 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.039+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cfc003610 con 0x7f0d2c0ba350 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.040+0000 7f986d7fa640 10 client.?.objecter ms_handle_connect 0x7f98780ba3b0 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.040+0000 7f986d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.042+0000 7f51ce7fc640 10 client.?.objecter ms_handle_connect 0x7f51e00ba350 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.042+0000 7f51ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f053c0b96a0 con 0x7f053c0ba350 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0530003d30 con 0x7f053c0ba350 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0517fff640 10 monclient: dump: 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f0539ffb640 4 set_mon_vals no callback set 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858018268 0 0) 0x7f8078164af0 con 0x7f80780b9f80 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): my global_id is 4453 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078164dd0 con 0x7f80780b9f80 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286023763 0 0) 0x7f80781fe240 con 0x7f80780585e0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 10 monclient(hunting): my global_id is 4422 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.043+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078164af0 con 0x7f80780585e0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2601856045 0 0) 0x7fbc00160600 con 0x7fbc000585e0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbd0003610 con 0x7fbc000585e0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbbec003190 con 0x7fbc000585e0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fbbfcff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0530003f40 con 0x7f053c0ba350 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271052468 0 0) 0x7fdd5c0b1850 con 0x7fdd5c15e580 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 10 monclient(hunting): my global_id is 4462 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd28003610 con 0x7fdd5c15e580 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.044+0000 7f053b7fe640 10 monclient: get_auth_request con 0x7f050c079ff0 auth_method 0 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 10 client.4445.objecter ms_handle_connect 0x7f050c079ff0 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f262d992640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f26280b9f80 0x7f26280b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:46256/0 (socket says 10.20.193.21:46256) 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f262d992640 1 -- 10.20.193.21:0/2625026327 learned_addr learned my addr 10.20.193.21:0/2625026327 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0530095e10 con 0x7f053c0ba350 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 10 client.4445.objecter ms_dispatch2 0x7f053c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 3 client.4445.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 3 client.4445.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 10 client.4445.objecter checking command 1 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter _get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 15 client.4445.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter _get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 15 client.4445.objecter _session_command_op_assign 7 1 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 4 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 10 client.4445.objecter _send_command 1 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.72:6813/85233281 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f050c0c5120 con 0x7f050c0a3520 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 20 client.4445.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f053005b3e0 con 0x7f053c0ba350 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0517fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0d28ff9640 10 client.?.objecter ms_handle_connect 0x7f0d2c0585e0 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f0d28ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7f053affd640 10 monclient: get_auth_request con 0x7f050c0a3520 auth_method 0 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359335479 0 0) 0x7ff09c1fd440 con 0x7ff09c0585e0 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 10 monclient(hunting): my global_id is 4466 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.045+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c1fd160 con 0x7ff09c0585e0 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 10 client.4399.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 15 client.4399.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 20 client.4399.objecter _get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 20 client.4399.objecter _get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 15 client.4399.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 20 client.4399.objecter get_session s=0x7f98f80a2ec0 osd=0 3 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 15 client.4399.objecter _session_command_op_assign 0 2 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 4 2026-02-25T15:01:19.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 10 client.4399.objecter _send_command 2 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.046+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 --> v1:10.20.193.21:6804/2253484549 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99281679a0 con 0x7f98f80a3570 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f0517fff640 10 client.4445.objecter ms_handle_connect 0x7f050c0a3520 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176630791 0 0) 0x7f7b300b23b0 con 0x7f7b300ba350 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 10 monclient(hunting): my global_id is 4459 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.047+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b00003610 con 0x7f7b300ba350 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f260effd640 10 client.?.objecter ms_handle_connect 0x7f26280585e0 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f260effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112758933 0 0) 0x7f7b300b2690 con 0x7f7b300585e0 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 10 monclient(hunting): my global_id is 4469 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b300b23b0 con 0x7f7b300585e0 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288796725 0 0) 0x7f406c139890 con 0x7f406c058070 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.112 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 10 monclient(hunting): my global_id is 4475 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f403c003610 con 0x7f406c058070 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850862312 0 0) 0x7f98781380c0 con 0x7f987815deb0 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 10 monclient(hunting): my global_id is 4472 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.048+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9878137de0 con 0x7f987815deb0 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990590846 0 0) 0x7f51e0161780 con 0x7f51e00b9f80 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 10 monclient(hunting): my global_id is 4478 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51b0003610 con 0x7f51e00b9f80 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877560669 0 0) 0x7f0d2c0b3480 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 10 monclient(hunting): my global_id is 4481 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d2c0b2c80 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f9924ff9640 1 -- 10.20.193.21:0/1435042611 <== osd.0 v1:10.20.193.21:6804/2253484549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f99281679a0 con 0x7f98f80a3570 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f9924ff9640 10 client.4399.objecter ms_dispatch2 0x7f9928000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f9924ff9640 10 client.4399.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f9924ff9640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 4 2026-02-25T15:01:19.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f9924ff9640 15 client.4399.objecter _session_command_op_remove 0 2 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92989364 0 0) 0x7f7b300b4ea0 con 0x7f7b300b9f80 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 10 monclient(hunting): my global_id is 4425 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b300b2690 con 0x7f7b300b9f80 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f4043fff640 10 client.?.objecter ms_handle_connect 0x7f406c159e40 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f4043fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 10 librados: watch_flush enter 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 10 librados: watch_flush exit 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 10 client.4399.objecter close_session for osd.0 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 >> v1:10.20.193.21:6804/2253484549 conn(0x7f98f80a3570 legacy=0x7f98f80c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 20 client.4399.objecter put_session s=0x7f98f80a2ec0 osd=0 1 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 20 client.4399.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 10 client.4399.objecter successfully canceled tick 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 >> v1:10.20.193.72:6800/2463505645 conn(0x7f98f807a040 legacy=0x7f98f809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 10 monclient: shutdown 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 >> v1:10.20.193.31:6789/0 conn(0x7f992815d440 legacy=0x7f992812aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992cdd1640 1 -- 10.20.193.21:0/1435042611 reap_dead start 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 shutdown_connections 2026-02-25T15:01:19.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 >> 10.20.193.21:0/1435042611 conn(0x7f99280b2ef0 msgr2=0x7f992815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f260effd640 10 client.?.objecter ms_handle_connect 0x7f26280ba350 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f260effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 shutdown_connections 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 -- 10.20.193.21:0/1435042611 wait complete. 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f992e85b640 1 librados: shutdown 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1723565917 0 0) 0x7f3cd4003610 con 0x7f3d040585e0 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d041fcd70 con 0x7f3d040585e0 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3cf4003000 con 0x7f3d040585e0 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.049+0000 7f3ceaffd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.050+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== osd.1 v1:10.20.193.31:6808/1809978267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f4a30003190 con 0x7f4a0c0a3790 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.050+0000 7f4a2a7fc640 10 client.4401.objecter ms_dispatch2 0x7f4a3c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.050+0000 7f4a2a7fc640 10 client.4401.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.050+0000 7f4a2a7fc640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 4 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.050+0000 7f4a2a7fc640 15 client.4401.objecter _session_command_op_remove 1 1 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910943470 0 0) 0x7f26280b2040 con 0x7f26280585e0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 10 monclient(hunting): my global_id is 4440 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.051+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25f8003610 con 0x7f26280585e0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2383814140 0 0) 0x7f3d041fd050 con 0x7f3d040ba350 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 >> v1:10.20.193.31:6789/0 conn(0x7f3d040b9f80 legacy=0x7f3d04155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 >> v1:10.20.193.21:6789/0 conn(0x7f3d040585e0 legacy=0x7f3d041fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 1 monclient: found mon.c 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d041fd330 con 0x7f3d040ba350 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3ceaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 5 monclient: authenticate success, global_id 4454 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 monclient: _renew_subs 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d041fd610 con 0x7f3d040ba350 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 monclient: _renew_subs 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d041f91b0 con 0x7f3d040ba350 2026-02-25T15:01:19.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 1 librados: init done 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f260effd640 10 client.?.objecter ms_handle_connect 0x7f26280b9f80 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f260effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 client.4454.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 15 client.4454.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 20 client.4454.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.052+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3d040b64c0 con 0x7f3d040ba350 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 208590924 0 0) 0x7f8044003610 con 0x7f80780ba350 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80781fe240 con 0x7f80780ba350 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f80680043a0 con 0x7f80780ba350 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7f80577fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7fdd3b7fe640 10 client.?.objecter ms_handle_connect 0x7fdd5c15e1b0 2026-02-25T15:01:19.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.054+0000 7fdd3b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89849212 0 0) 0x7f51e01614a0 con 0x7f51e00585e0 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 10 monclient(hunting): my global_id is 4468 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.055+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e0161780 con 0x7f51e00585e0 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462227503 0 0) 0x7f406c1395b0 con 0x7f406c159a70 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 10 monclient(hunting): my global_id is 4471 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.056+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f406c139890 con 0x7f406c159a70 2026-02-25T15:01:19.118 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:19.118 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 10 client.4401.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 15 client.4401.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 20 client.4401.objecter _get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 20 client.4401.objecter _get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 15 client.4401.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 20 client.4401.objecter get_session s=0x7f4a0c0a30e0 osd=1 3 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 15 client.4401.objecter _session_command_op_assign 1 2 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 4 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 10 client.4401.objecter _send_command 2 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 --> v1:10.20.193.31:6808/1809978267 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4a3c157440 con 0x7f4a0c0a3790 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 315924604 0 0) 0x7f25f8003610 con 0x7f26280585e0 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26280b2040 con 0x7f26280585e0 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2618002cc0 con 0x7f26280585e0 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.119 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.057+0000 7f260effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2212797662 0 0) 0x7f798c13c4f0 con 0x7f798c057480 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 >> v1:10.20.193.31:6789/0 conn(0x7f798c15d5d0 legacy=0x7f798c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 >> v1:10.20.193.21:6789/0 conn(0x7f798c0b4ba0 legacy=0x7f798c0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 1 monclient: found mon.c 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c0b1e90 con 0x7f798c057480 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7979ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 5 monclient: authenticate success, global_id 4451 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 monclient: _renew_subs 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f798c0b2170 con 0x7f798c057480 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 monclient: _renew_subs 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f798c0b2730 con 0x7f798c057480 2026-02-25T15:01:19.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 1 librados: init done 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816536099 0 0) 0x7fdd5c0b1b30 con 0x7fdd5c083dc0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 10 monclient(hunting): my global_id is 4484 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5c0b1850 con 0x7fdd5c083dc0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3086777098 0 0) 0x7fbc001fee00 con 0x7fbc000b9f80 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 >> v1:10.20.193.31:6789/0 conn(0x7fbc000585e0 legacy=0x7fbc0015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 >> v1:10.20.193.21:6789/0 conn(0x7fbc000ba350 legacy=0x7fbc00164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 1 monclient: found mon.c 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc001608e0 con 0x7fbc000b9f80 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbbfcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 5 monclient: authenticate success, global_id 4457 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 10 monclient: _renew_subs 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc00160bc0 con 0x7fbc000b9f80 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 10 monclient: _renew_subs 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc001ff110 con 0x7fbc000b9f80 2026-02-25T15:01:19.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7fbc0659b640 1 librados: init done 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.059+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f798c164890 con 0x7f798c057480 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 10 client.4457.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 15 client.4457.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 20 client.4457.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbbc0003950 con 0x7fbc000b9f80 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a2a7fc640 1 -- 10.20.193.21:0/1051023730 <== osd.1 v1:10.20.193.31:6808/1809978267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f4a3c157440 con 0x7f4a0c0a3790 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a2a7fc640 10 client.4401.objecter ms_dispatch2 0x7f4a3c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a2a7fc640 10 client.4401.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a2a7fc640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 4 2026-02-25T15:01:19.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a2a7fc640 15 client.4401.objecter _session_command_op_remove 1 2 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 10 librados: watch_flush enter 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 10 librados: watch_flush exit 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 10 client.4401.objecter close_session for osd.1 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 >> v1:10.20.193.31:6808/1809978267 conn(0x7f4a0c0a3790 legacy=0x7f4a0c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 20 client.4401.objecter put_session s=0x7f4a0c0a30e0 osd=1 1 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 20 client.4401.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 10 client.4401.objecter successfully canceled tick 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 >> v1:10.20.193.72:6800/2463505645 conn(0x7f4a0c07a260 legacy=0x7f4a0c09a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 10 monclient: shutdown 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 >> v1:10.20.193.21:6789/0 conn(0x7f4a3c0b9f80 legacy=0x7f4a3c172620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a42539640 1 -- 10.20.193.21:0/1051023730 reap_dead start 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 shutdown_connections 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 >> 10.20.193.21:0/1051023730 conn(0x7f4a3c0b7990 msgr2=0x7f4a3c0b91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 shutdown_connections 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 -- 10.20.193.21:0/1051023730 wait complete. 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7f4a43fc3640 1 librados: shutdown 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6d8003570 con 0x7fe6dc0ba300 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe6d8003c50 con 0x7fe6dc0ba300 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6e0a7c640 4 set_mon_vals no callback set 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7fe6c2ffd640 10 monclient: dump: 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.123 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163978526 0 0) 0x7ff09c1fe2a0 con 0x7ff09c0b9f80 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 10 monclient(hunting): my global_id is 4428 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.060+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff09c1fd440 con 0x7ff09c0b9f80 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036497587 0 0) 0x7f51e00b7060 con 0x7f51e00ba350 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 10 monclient(hunting): my global_id is 4434 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e01614a0 con 0x7f51e00ba350 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe6d8003e30 con 0x7fe6dc0ba300 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.061+0000 7fe6e227f640 10 monclient: get_auth_request con 0x7fe6ac079f80 auth_method 0 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.062+0000 7fe6c2ffd640 10 client.4444.objecter ms_handle_connect 0x7fe6ac079f80 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1995815934 0 0) 0x7f7b300b23b0 con 0x7f7b300585e0 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b300b4ea0 con 0x7f7b300585e0 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7b24002d30 con 0x7f7b300585e0 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f7b07fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870571514 0 0) 0x7f9878137b00 con 0x7f98780ba3b0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 10 monclient(hunting): my global_id is 4431 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98781380c0 con 0x7f98780ba3b0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2687077365 0 0) 0x7f26280b2040 con 0x7f26280585e0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 >> v1:10.20.193.68:6789/0 conn(0x7f26280ba350 legacy=0x7f2628159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 >> v1:10.20.193.31:6789/0 conn(0x7f26280b9f80 legacy=0x7f26280b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 1 monclient: found mon.a 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26280b28e0 con 0x7f26280585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f260effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 5 monclient: authenticate success, global_id 4440 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 10 monclient: _renew_subs 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26280b2bc0 con 0x7f26280585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 10 monclient: _renew_subs 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f26280b0c40 con 0x7f26280585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f263041e640 1 librados: init done 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600688985 0 0) 0x7f0d2c0b4f10 con 0x7f0d2c0585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 10 monclient(hunting): my global_id is 4437 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.065+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d2c0b3480 con 0x7f0d2c0585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 10 client.4440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 15 client.4440.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 20 client.4440.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f26280b1df0 con 0x7f26280585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3055118432 0 0) 0x7f8078164af0 con 0x7f80780585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8044003610 con 0x7f80780585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f806c003350 con 0x7f80780585e0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.126 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.066+0000 7f80577fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2226696031 0 0) 0x7f7b300b2690 con 0x7f7b300b9f80 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b300b23b0 con 0x7f7b300b9f80 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7b180030c0 con 0x7f7b300b9f80 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.067+0000 7f7b07fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.127 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:19.128 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe6d8095f80 con 0x7fe6dc0ba300 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 10 client.4444.objecter ms_dispatch2 0x7fe6dc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 3 client.4444.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 3 client.4444.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 10 client.4444.objecter checking command 1 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter _get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 15 client.4444.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter _get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 15 client.4444.objecter _session_command_op_assign 4 1 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 4 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 10 client.4444.objecter _send_command 1 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.21:6812/2726560095 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6ac0c50b0 con 0x7fe6ac0a34b0 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 20 client.4444.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fe6d805efb0 con 0x7fe6dc0ba300 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6c2ffd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== osd.7 v1:10.20.193.72:6813/85233281 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f050c0c5120 con 0x7f050c0a3520 2026-02-25T15:01:19.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7f0517fff640 10 client.4445.objecter ms_dispatch2 0x7f053c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7f0517fff640 10 client.4445.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7f0517fff640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 4 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7f0517fff640 15 client.4445.objecter _session_command_op_remove 7 1 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7fe6e1a7e640 10 monclient: get_auth_request con 0x7fe6ac0a34b0 auth_method 0 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1502581727 0 0) 0x7ff06c003610 con 0x7ff09c0ba350 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff09c1fe2a0 con 0x7ff09c0ba350 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff08c003080 con 0x7ff09c0ba350 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.068+0000 7ff073fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3967890335 0 0) 0x7f9848003610 con 0x7f987815e280 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9878137b00 con 0x7f987815e280 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9874003430 con 0x7f987815e280 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.069+0000 7f986d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463490463 0 0) 0x7f406c166030 con 0x7f406c159e40 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 10 monclient(hunting): my global_id is 4443 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f406c1395b0 con 0x7f406c159e40 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.070+0000 7fe6c2ffd640 10 client.4444.objecter ms_handle_connect 0x7fe6ac0a34b0 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1245073535 0 0) 0x7f51b0003610 con 0x7f51e00b9f80 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51e00b7060 con 0x7f51e00b9f80 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f51d40030f0 con 0x7f51e00b9f80 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 10 monclient(hunting): dump: 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.130 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f51ce7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 819009786 0 0) 0x7f0d2c0b2c80 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d2c0b4f10 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d1c002fb0 con 0x7f0d2c0b9f80 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f0d28ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 153868533 0 0) 0x7f7b300b4ea0 con 0x7f7b300585e0 2026-02-25T15:01:19.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 >> v1:10.20.193.31:6789/0 conn(0x7f7b300ba350 legacy=0x7f7b301fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 >> v1:10.20.193.21:6789/0 conn(0x7f7b300b9f80 legacy=0x7f7b301fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 1 monclient: found mon.c 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300b2970 con 0x7f7b300585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b35a16640 5 monclient: authenticate success, global_id 4469 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b35a16640 10 monclient: _renew_subs 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b35a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.074+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b300b2c50 con 0x7f7b300585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 monclient: _renew_subs 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b300b3210 con 0x7f7b300585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 1 librados: init done 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1345805563 0 0) 0x7ff09c1fd160 con 0x7ff09c0585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff06c003610 con 0x7ff09c0585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff090002f70 con 0x7ff09c0585e0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7ff073fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 client.4469.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 15 client.4469.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 20 client.4469.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.075+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7b300b64c0 con 0x7f7b300585e0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 10 client.4445.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 15 client.4445.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 20 client.4445.objecter _get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 20 client.4445.objecter _get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 15 client.4445.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 20 client.4445.objecter get_session s=0x7f050c0a2e70 osd=7 3 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 15 client.4445.objecter _session_command_op_assign 7 2 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 4 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 10 client.4445.objecter _send_command 2 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 --> v1:10.20.193.72:6813/85233281 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f053c0b93c0 con 0x7f050c0a3520 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3574467834 0 0) 0x7f9878137de0 con 0x7f987815deb0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9848003610 con 0x7f987815deb0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9860002fb0 con 0x7f987815deb0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.077+0000 7f986d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.133 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 694124909 0 0) 0x7f8078164dd0 con 0x7f80780b9f80 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8078164af0 con 0x7f80780b9f80 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8060002fb0 con 0x7f80780b9f80 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f80577fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f0517fff640 1 -- 10.20.193.21:0/2997712336 <== osd.7 v1:10.20.193.72:6813/85233281 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f053c0b93c0 con 0x7f050c0a3520 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f0517fff640 10 client.4445.objecter ms_dispatch2 0x7f053c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f0517fff640 10 client.4445.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f0517fff640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 4 2026-02-25T15:01:19.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.079+0000 7f0517fff640 15 client.4445.objecter _session_command_op_remove 7 2 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 10 librados: watch_flush enter 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 10 librados: watch_flush exit 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 10 client.4445.objecter close_session for osd.7 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 >> v1:10.20.193.72:6813/85233281 conn(0x7f050c0a3520 legacy=0x7f050c0c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 20 client.4445.objecter put_session s=0x7f050c0a2e70 osd=7 1 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 20 client.4445.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 10 client.4445.objecter successfully canceled tick 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 >> v1:10.20.193.72:6800/2463505645 conn(0x7f050c079ff0 legacy=0x7f050c09a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 10 monclient: shutdown 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 >> v1:10.20.193.68:6789/0 conn(0x7f053c0ba350 legacy=0x7f053c1645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f053bfff640 1 -- 10.20.193.21:0/2997712336 reap_dead start 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 shutdown_connections 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 >> 10.20.193.21:0/2997712336 conn(0x7f053c0b7990 msgr2=0x7f053c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 shutdown_connections 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 -- 10.20.193.21:0/2997712336 wait complete. 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7f0541a8a640 1 librados: shutdown 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871732784 0 0) 0x7fdd5c1fedb0 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): my global_id is 4446 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd5c0b1b30 con 0x7fdd5c15e1b0 2026-02-25T15:01:19.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4131549968 0 0) 0x7fdd28003610 con 0x7fdd5c15e580 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd5c1fedb0 con 0x7fdd5c15e580 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdd4c0036d0 con 0x7fdd5c15e580 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.080+0000 7fdd3b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 84659298 0 0) 0x7f0cfc003610 con 0x7f0d2c0ba350 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d2c0b2c80 con 0x7f0d2c0ba350 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d20003470 con 0x7f0d2c0ba350 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.082+0000 7f0d28ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 837654104 0 0) 0x7f51e0161780 con 0x7f51e00585e0 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51b0003610 con 0x7f51e00585e0 2026-02-25T15:01:19.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f51d00030b0 con 0x7f51e00585e0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f51ce7fc640 10 monclient(hunting): dump: 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4019116962 0 0) 0x7ff09c1fe2a0 con 0x7ff09c0ba350 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 >> v1:10.20.193.68:6789/0 conn(0x7ff09c0585e0 legacy=0x7ff09c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 >> v1:10.20.193.21:6789/0 conn(0x7ff09c0b9f80 legacy=0x7ff09c1f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 1 monclient: found mon.b 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c1fd720 con 0x7ff09c0ba350 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff073fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 5 monclient: authenticate success, global_id 4450 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 monclient: _renew_subs 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1fda00 con 0x7ff09c0ba350 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 monclient: _renew_subs 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff09c1fdfc0 con 0x7ff09c0ba350 2026-02-25T15:01:19.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 1 librados: init done 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1703820742 0 0) 0x7f406c139890 con 0x7f406c159a70 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f406c166030 con 0x7f406c159a70 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4054003060 con 0x7f406c159a70 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f4043fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 client.4450.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 15 client.4450.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 20 client.4450.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff09c0b8fe0 con 0x7ff09c0ba350 2026-02-25T15:01:19.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26280b1df0 con 0x7f26280585e0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f26180034e0 con 0x7f26280585e0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f262c990640 4 set_mon_vals no callback set 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.084+0000 7f260effd640 10 monclient: dump: 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.085+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f261801ccf0 con 0x7f26280585e0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.086+0000 7f262d992640 10 monclient: get_auth_request con 0x7f25f8079f10 auth_method 0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.086+0000 7f260effd640 10 client.4440.objecter ms_handle_connect 0x7f25f8079f10 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3246635253 0 0) 0x7fdd5c1fedb0 con 0x7fdd5c15e580 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 >> v1:10.20.193.68:6789/0 conn(0x7fdd5c083dc0 legacy=0x7fdd5c1fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 >> v1:10.20.193.21:6789/0 conn(0x7fdd5c15e1b0 legacy=0x7fdd5c1fcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 1 monclient: found mon.b 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5c0b1e10 con 0x7fdd5c15e580 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 5 monclient: authenticate success, global_id 4462 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 monclient: _renew_subs 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5c1fc580 con 0x7fdd5c15e580 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 monclient: _renew_subs 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd5c1ff220 con 0x7fdd5c15e580 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 1 librados: init done 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.087+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdd5c0b8310 con 0x7fdd5c15e580 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:19.140 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== osd.4 v1:10.20.193.21:6812/2726560095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe6ac0c50b0 con 0x7fe6ac0a34b0 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7fe6c2ffd640 10 client.4444.objecter ms_dispatch2 0x7fe6dc000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7fe6c2ffd640 10 client.4444.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7fe6c2ffd640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 4 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7fe6c2ffd640 15 client.4444.objecter _session_command_op_remove 4 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f2618094870 con 0x7f26280585e0 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 10 client.4440.objecter ms_dispatch2 0x7f2628000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 3 client.4440.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 3 client.4440.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 10 client.4440.objecter checking command 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter _get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 15 client.4440.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter _get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 15 client.4440.objecter _session_command_op_assign 3 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 4 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 10 client.4440.objecter _send_command 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.72:6805/464837367 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25f80c5040 con 0x7f25f80a3440 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f261805d8a0 con 0x7f26280585e0 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f260effd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d040b64c0 con 0x7f3d040ba350 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d00003a80 con 0x7f3d040ba350 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3d08811640 4 set_mon_vals no callback set 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.090+0000 7f3ceaffd640 10 monclient: dump: 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.141 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.091+0000 7f262e994640 10 monclient: get_auth_request con 0x7f25f80a3440 auth_method 0 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.091+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3d00003c60 con 0x7f3d040ba350 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.092+0000 7f3d0a014640 10 monclient: get_auth_request con 0x7f3cd4079fe0 auth_method 0 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.092+0000 7f3ceaffd640 10 client.4454.objecter ms_handle_connect 0x7f3cd4079fe0 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.092+0000 7f260effd640 10 client.4440.objecter ms_handle_connect 0x7f25f80a3440 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f3d00094bf0 con 0x7f3d040ba350 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 10 client.4454.objecter ms_dispatch2 0x7f3d04000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 3 client.4454.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 3 client.4454.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 10 client.4454.objecter checking command 1 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter _get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 15 client.4454.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter _get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 15 client.4454.objecter _session_command_op_assign 5 1 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 4 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 10 client.4454.objecter _send_command 1 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.31:6812/2854385794 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cd40c5110 con 0x7f3cd40a3510 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 20 client.4454.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f3d0005dc20 con 0x7f3d040ba350 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3ceaffd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2736283263 0 0) 0x7f98781380c0 con 0x7f98780ba3b0 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9878137de0 con 0x7f98780ba3b0 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9868003310 con 0x7f98780ba3b0 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 621846239 0 0) 0x7f9878137b00 con 0x7f987815e280 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 >> v1:10.20.193.68:6789/0 conn(0x7f987815deb0 legacy=0x7f98781196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 >> v1:10.20.193.21:6789/0 conn(0x7f98780ba3b0 legacy=0x7f9878165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 monclient: found mon.b 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98781383a0 con 0x7f987815e280 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f986d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 5 monclient: authenticate success, global_id 4456 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 10 monclient: _renew_subs 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9878118ec0 con 0x7f987815e280 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 10 monclient: _renew_subs 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9878119dd0 con 0x7f987815e280 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f987eaf3640 1 librados: init done 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1072395759 0 0) 0x7f403c003610 con 0x7f406c058070 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f406c139890 con 0x7f406c058070 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4060003350 con 0x7f406c058070 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f4043fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f3d09813640 10 monclient: get_auth_request con 0x7f3cd40a3510 auth_method 0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3569010194 0 0) 0x7f0d2c0b2c80 con 0x7f0d2c0ba350 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3541881431 0 0) 0x7f51e00b7060 con 0x7f51e00b9f80 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 >> v1:10.20.193.68:6789/0 conn(0x7f0d2c0b9f80 legacy=0x7f0d2c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 >> v1:10.20.193.21:6789/0 conn(0x7f0d2c0585e0 legacy=0x7f0d2c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 >> v1:10.20.193.31:6789/0 conn(0x7f51e00585e0 legacy=0x7f51e01fc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 >> v1:10.20.193.21:6789/0 conn(0x7f51e00ba350 legacy=0x7f51e01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 1 monclient: found mon.b 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 1 monclient: found mon.c 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e0161a60 con 0x7f51e00b9f80 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c0b3760 con 0x7f0d2c0ba350 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 5 monclient: authenticate success, global_id 4465 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 10 monclient: _renew_subs 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c0b3a40 con 0x7f0d2c0ba350 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 5 monclient: authenticate success, global_id 4478 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 10 monclient: _renew_subs 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f51e0161d40 con 0x7f51e00b9f80 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 10 monclient: _renew_subs 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d2c0b4000 con 0x7f0d2c0ba350 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f0d324c6640 1 librados: init done 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 10 monclient: _renew_subs 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51e0161020 con 0x7f51e00b9f80 2026-02-25T15:01:19.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f51e7f02640 1 librados: init done 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 475567799 0 0) 0x7f80781fe240 con 0x7f80780ba350 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 >> v1:10.20.193.31:6789/0 conn(0x7f80780b9f80 legacy=0x7f8078165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 >> v1:10.20.193.21:6789/0 conn(0x7f80780585e0 legacy=0x7f80781fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 1 monclient: found mon.c 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80781650b0 con 0x7f80780ba350 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f80577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.093+0000 7f807d71a640 5 monclient: authenticate success, global_id 4463 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 monclient: _renew_subs 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 10 client.4456.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 15 client.4456.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 20 client.4456.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f987811a0b0 con 0x7f987815e280 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8078165390 con 0x7f80780ba350 2026-02-25T15:01:19.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 monclient: _renew_subs 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f80781662a0 con 0x7f80780ba350 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 1 librados: init done 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 10 client.4465.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 15 client.4465.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 20 client.4465.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0d2c0b64c0 con 0x7f0d2c0ba350 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 10 client.4478.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 15 client.4478.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 20 client.4478.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f51e0159660 con 0x7f51e00b9f80 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 client.4463.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 15 client.4463.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 20 client.4463.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.094+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f807804b790 con 0x7f80780ba350 2026-02-25T15:01:19.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.095+0000 7f3ceaffd640 10 client.4454.objecter ms_handle_connect 0x7f3cd40a3510 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 10 client.4444.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 15 client.4444.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 20 client.4444.objecter _get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 20 client.4444.objecter _get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 15 client.4444.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 20 client.4444.objecter get_session s=0x7fe6ac0a2e00 osd=4 3 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 15 client.4444.objecter _session_command_op_assign 4 2 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 4 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 10 client.4444.objecter _send_command 2 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.098+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 --> v1:10.20.193.21:6812/2726560095 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe6dc1633a0 con 0x7fe6ac0a34b0 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f798c164890 con 0x7f798c057480 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f797c003780 con 0x7f798c057480 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 10 monclient: dump: 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f797b7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff09c0b8fe0 con 0x7ff09c0ba350 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff08c0032b0 con 0x7ff09c0ba350 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff0997fa640 4 set_mon_vals no callback set 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7ff073fff640 10 monclient: dump: 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.099+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f797c003990 con 0x7f798c057480 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff08c01e240 con 0x7ff09c0ba350 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f7990ddb640 10 monclient: get_auth_request con 0x7f795c079ed0 auth_method 0 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f7979ffb640 10 client.4451.objecter ms_handle_connect 0x7f795c079ed0 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3784466555 0 0) 0x7f406c1395b0 con 0x7f406c159e40 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f403c003610 con 0x7f406c159e40 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f405c0032f0 con 0x7f406c159e40 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7f4043fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.100+0000 7ff09affd640 10 monclient: get_auth_request con 0x7ff06c079fe0 auth_method 0 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7ff073fff640 10 client.4450.objecter ms_handle_connect 0x7ff06c079fe0 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6c2ffd640 1 -- 10.20.193.21:0/3497067773 <== osd.4 v1:10.20.193.21:6812/2726560095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fe6dc1633a0 con 0x7fe6ac0a34b0 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6c2ffd640 10 client.4444.objecter ms_dispatch2 0x7fe6dc000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6c2ffd640 10 client.4444.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6c2ffd640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 4 2026-02-25T15:01:19.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6c2ffd640 15 client.4444.objecter _session_command_op_remove 4 2 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 10 librados: watch_flush enter 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 10 librados: watch_flush exit 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 10 client.4444.objecter close_session for osd.4 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 >> v1:10.20.193.21:6812/2726560095 conn(0x7fe6ac0a34b0 legacy=0x7fe6ac0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 20 client.4444.objecter put_session s=0x7fe6ac0a2e00 osd=4 1 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 20 client.4444.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 10 client.4444.objecter successfully canceled tick 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe6ac079f80 legacy=0x7fe6ac09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 10 monclient: shutdown 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.101+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 >> v1:10.20.193.31:6789/0 conn(0x7fe6dc0ba300 legacy=0x7fe6dc166380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e2a80640 1 -- 10.20.193.21:0/3497067773 reap_dead start 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 shutdown_connections 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 >> 10.20.193.21:0/3497067773 conn(0x7fe6dc0b7990 msgr2=0x7fe6dc16a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 shutdown_connections 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e450a640 1 -- 10.20.193.21:0/3497067773 wait complete. 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7fe6e450a640 1 librados: shutdown 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7ff08c095c60 con 0x7ff09c0ba350 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 10 client.4450.objecter ms_dispatch2 0x7ff09c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 3 client.4450.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 3 client.4450.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 10 client.4450.objecter checking command 1 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter _get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 15 client.4450.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter _get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 15 client.4450.objecter _session_command_op_assign 15 1 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 4 2026-02-25T15:01:19.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 10 client.4450.objecter _send_command 1 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.72:6801/4086098431 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff06c0c5110 con 0x7ff06c0a3510 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.102+0000 7ff073fff640 20 client.4450.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.103+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7ff08c05b230 con 0x7ff09c0ba350 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.103+0000 7ff073fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.103+0000 7ff09a7fc640 10 monclient: get_auth_request con 0x7ff06c0a3510 auth_method 0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.104+0000 7ff073fff640 10 client.4450.objecter ms_handle_connect 0x7ff06c0a3510 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1757180344 0 0) 0x7f403c003610 con 0x7f406c159e40 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 >> v1:10.20.193.68:6789/0 conn(0x7f406c058070 legacy=0x7f406c165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 >> v1:10.20.193.31:6789/0 conn(0x7f406c159a70 legacy=0x7f406c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 1 monclient: found mon.a 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406c139b70 con 0x7f406c159e40 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4043fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 5 monclient: authenticate success, global_id 4443 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 10 monclient: _renew_subs 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f406c15f4c0 con 0x7f406c159e40 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 10 monclient: _renew_subs 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f406c1603d0 con 0x7f406c159e40 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.108+0000 7f4071945640 1 librados: init done 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 10 client.4443.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 15 client.4443.objecter _session_command_op_assign -1 1 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 20 client.4443.objecter _get_session osd=-1 returning homeless 2026-02-25T15:01:19.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 10 client.4443.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f406c1606b0 con 0x7f406c159e40 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f797c0959d0 con 0x7f798c057480 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 10 client.4451.objecter ms_dispatch2 0x7f798c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 3 client.4451.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 3 client.4451.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 10 client.4451.objecter checking command 1 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter _get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter _get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 15 client.4451.objecter _session_command_op_assign 6 1 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 4 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 10 client.4451.objecter _send_command 1 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6808/359632495 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f795c0c5000 con 0x7f795c0a3400 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f797c05afa0 con 0x7f798c057480 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.109+0000 7f7979ffb640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.154 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:19.155 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.110+0000 7f7991ddd640 10 monclient: get_auth_request con 0x7f795c0a3400 auth_method 0 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== osd.3 v1:10.20.193.72:6805/464837367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f25f80c5040 con 0x7f25f80a3440 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f260effd640 10 client.4440.objecter ms_dispatch2 0x7f2628000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f260effd640 10 client.4440.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f260effd640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 4 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f260effd640 15 client.4440.objecter _session_command_op_remove 3 1 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.111+0000 7f7979ffb640 10 client.4451.objecter ms_handle_connect 0x7f795c0a3400 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.114+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== osd.5 v1:10.20.193.31:6812/2854385794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3cd40c5110 con 0x7f3cd40a3510 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.114+0000 7f3ceaffd640 10 client.4454.objecter ms_dispatch2 0x7f3d04000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.114+0000 7f3ceaffd640 10 client.4454.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.114+0000 7f3ceaffd640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 4 2026-02-25T15:01:19.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.114+0000 7f3ceaffd640 15 client.4454.objecter _session_command_op_remove 5 1 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f406c1606b0 con 0x7f406c159e40 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f405c003490 con 0x7f406c159e40 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f40697fa640 4 set_mon_vals no callback set 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.117+0000 7f4043fff640 10 monclient: dump: 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f405c0036a0 con 0x7f406c159e40 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd5c0b8310 con 0x7fdd5c15e580 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fdd4c003dd0 con 0x7fdd5c15e580 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd3b7fe640 10 monclient: dump: 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.156 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.118+0000 7fdd597fa640 4 set_mon_vals no callback set 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f406affd640 10 monclient: get_auth_request con 0x7f403c07a160 auth_method 0 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 10 client.4443.objecter ms_handle_connect 0x7f403c07a160 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fdd4c003fe0 con 0x7fdd5c15e580 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f405c003490 con 0x7f406c159e40 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 10 client.4443.objecter ms_dispatch2 0x7f406c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 3 client.4443.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 3 client.4443.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.119+0000 7f4043fff640 10 client.4443.objecter checking command 1 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter _get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 15 client.4443.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter _get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 15 client.4443.objecter _session_command_op_assign 9 1 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 4 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 10 client.4443.objecter _send_command 1 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.31:6800/3462355980 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f405c004430 con 0x7f403c0a3690 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 20 client.4443.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f405c05d900 con 0x7f406c159e40 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f4043fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 10 client.4440.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 15 client.4440.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 20 client.4440.objecter _get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 20 client.4440.objecter _get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 15 client.4440.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7fdd5affd640 10 monclient: get_auth_request con 0x7fdd28079fb0 auth_method 0 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 20 client.4440.objecter get_session s=0x7f25f80a2d90 osd=3 3 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 15 client.4440.objecter _session_command_op_assign 3 2 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 4 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 10 client.4440.objecter _send_command 2 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 --> v1:10.20.193.72:6805/464837367 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f26281678f0 con 0x7f25f80a3440 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7fdd3b7fe640 10 client.4462.objecter ms_handle_connect 0x7fdd28079fb0 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b300b64c0 con 0x7f7b300585e0 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7b240030b0 con 0x7f7b300585e0 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b2d7fa640 4 set_mon_vals no callback set 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f7b07fff640 10 monclient: dump: 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.158 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.120+0000 7f406a7fc640 10 monclient: get_auth_request con 0x7f403c0a3690 auth_method 0 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f7b2401e230 con 0x7f7b300585e0 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7f4043fff640 10 client.4443.objecter ms_handle_connect 0x7f403c0a3690 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7f7b2e7fc640 10 monclient: get_auth_request con 0x7f7b00079f80 auth_method 0 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fdd4c095cc0 con 0x7fdd5c15e580 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 10 client.4462.objecter ms_dispatch2 0x7fdd5c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 3 client.4462.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 3 client.4462.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 10 client.4462.objecter checking command 1 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7f7b07fff640 10 client.4469.objecter ms_handle_connect 0x7f7b00079f80 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter _get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter _get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 15 client.4462.objecter _session_command_op_assign 14 1 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 4 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 10 client.4462.objecter _send_command 1 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.68:6804/3496291144 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd280c50e0 con 0x7fdd280a34e0 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.121+0000 7fdd3b7fe640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7fdd5a7fc640 10 monclient: get_auth_request con 0x7fdd280a34e0 auth_method 0 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f260effd640 1 -- 10.20.193.21:0/2625026327 <== osd.3 v1:10.20.193.72:6805/464837367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f26281678f0 con 0x7f25f80a3440 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f260effd640 10 client.4440.objecter ms_dispatch2 0x7f2628000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f260effd640 10 client.4440.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f260effd640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 4 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f260effd640 15 client.4440.objecter _session_command_op_remove 3 2 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 10 librados: watch_flush enter 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 10 librados: watch_flush exit 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 10 client.4440.objecter close_session for osd.3 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 >> v1:10.20.193.72:6805/464837367 conn(0x7f25f80a3440 legacy=0x7f25f80c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 20 client.4440.objecter put_session s=0x7f25f80a2d90 osd=3 1 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.122+0000 7f263041e640 10 client.4440.objecter successfully canceled tick 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 >> v1:10.20.193.72:6800/2463505645 conn(0x7f25f8079f10 legacy=0x7f25f809a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 10 monclient: shutdown 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 >> v1:10.20.193.21:6789/0 conn(0x7f26280585e0 legacy=0x7f2628156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f262e994640 1 -- 10.20.193.21:0/2625026327 reap_dead start 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== osd.15 v1:10.20.193.72:6801/4086098431 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff06c0c5110 con 0x7ff06c0a3510 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7ff073fff640 10 client.4450.objecter ms_dispatch2 0x7ff09c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7ff073fff640 10 client.4450.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7ff073fff640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 4 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7ff073fff640 15 client.4450.objecter _session_command_op_remove 15 1 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 shutdown_connections 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 >> 10.20.193.21:0/2625026327 conn(0x7f26280b7990 msgr2=0x7f2628158140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 shutdown_connections 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 -- 10.20.193.21:0/2625026327 wait complete. 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f263041e640 1 librados: shutdown 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 10 client.4454.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 15 client.4454.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 20 client.4454.objecter _get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 20 client.4454.objecter _get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 15 client.4454.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 20 client.4454.objecter get_session s=0x7f3cd40a2e60 osd=5 3 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 15 client.4454.objecter _session_command_op_assign 5 2 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 4 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 10 client.4454.objecter _send_command 2 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 --> v1:10.20.193.31:6812/2854385794 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d04159390 con 0x7f3cd40a3510 2026-02-25T15:01:19.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.123+0000 7fdd3b7fe640 10 client.4462.objecter ms_handle_connect 0x7fdd280a34e0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f7b24095ae0 con 0x7f7b300585e0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 10 client.4469.objecter ms_dispatch2 0x7f7b30000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 3 client.4469.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 3 client.4469.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 10 client.4469.objecter checking command 1 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter _get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 15 client.4469.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter _get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 15 client.4469.objecter _session_command_op_assign 2 1 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 4 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 10 client.4469.objecter _send_command 1 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6812/3838375510 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b000c50b0 con 0x7f7b000a34b0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 20 client.4469.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b2f7fe640 10 monclient: get_auth_request con 0x7f7b000a34b0 auth_method 0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f7b2405b0b0 con 0x7f7b300585e0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.124+0000 7f7b07fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f987811a0b0 con 0x7f987815e280 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9874003c20 con 0x7f987815e280 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986effd640 4 set_mon_vals no callback set 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.125+0000 7f986d7fa640 10 monclient: dump: 2026-02-25T15:01:19.162 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f9874003e00 con 0x7f987815e280 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3ceaffd640 1 -- 10.20.193.21:0/1062810460 <== osd.5 v1:10.20.193.31:6812/2854385794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f3d04159390 con 0x7f3cd40a3510 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3ceaffd640 10 client.4454.objecter ms_dispatch2 0x7f3d04000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3ceaffd640 10 client.4454.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3ceaffd640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 4 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3ceaffd640 15 client.4454.objecter _session_command_op_remove 5 2 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f7b07fff640 10 client.4469.objecter ms_handle_connect 0x7f7b000a34b0 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 10 librados: watch_flush enter 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 10 librados: watch_flush exit 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 10 client.4454.objecter close_session for osd.5 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 >> v1:10.20.193.31:6812/2854385794 conn(0x7f3cd40a3510 legacy=0x7f3cd40c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 20 client.4454.objecter put_session s=0x7f3cd40a2e60 osd=5 1 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 20 client.4454.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 10 client.4454.objecter successfully canceled tick 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3cd4079fe0 legacy=0x7f3cd409a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 10 monclient: shutdown 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 >> v1:10.20.193.68:6789/0 conn(0x7f3d040ba350 legacy=0x7f3d040b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0a815640 1 -- 10.20.193.21:0/1062810460 reap_dead start 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 shutdown_connections 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 >> 10.20.193.21:0/1062810460 conn(0x7f3d040b7990 msgr2=0x7f3d0415b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 shutdown_connections 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 -- 10.20.193.21:0/1062810460 wait complete. 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f3d0c29f640 1 librados: shutdown 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f987c868640 10 monclient: get_auth_request con 0x7f984807a040 auth_method 0 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.126+0000 7f986d7fa640 10 client.4456.objecter ms_handle_connect 0x7f984807a040 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f9874095c90 con 0x7f987815e280 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 10 client.4456.objecter ms_dispatch2 0x7f9878000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 3 client.4456.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 3 client.4456.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fdd4c05b290 con 0x7fdd5c15e580 2026-02-25T15:01:19.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7fdd3b7fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 10 client.4456.objecter checking command 1 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter _get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 15 client.4456.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter _get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 15 client.4456.objecter _session_command_op_assign 8 1 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 4 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 10 client.4456.objecter _send_command 1 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.21:6800/3085828309 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98480c5210 con 0x7f98480a3570 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 20 client.4456.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f987405b260 con 0x7f987815e280 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.127+0000 7f986d7fa640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.128+0000 7f986ffff640 10 monclient: get_auth_request con 0x7f98480a3570 auth_method 0 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.129+0000 7f986d7fa640 10 client.4456.objecter ms_handle_connect 0x7f98480a3570 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 10 client.4450.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 15 client.4450.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 20 client.4450.objecter _get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 20 client.4450.objecter _get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 15 client.4450.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 20 client.4450.objecter get_session s=0x7ff06c0a2e60 osd=15 3 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 15 client.4450.objecter _session_command_op_assign 15 2 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 4 2026-02-25T15:01:19.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 10 client.4450.objecter _send_command 2 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.130+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 --> v1:10.20.193.72:6801/4086098431 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff09c159270 con 0x7ff06c0a3510 2026-02-25T15:01:19.166 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== osd.6 v1:10.20.193.68:6808/359632495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f795c0c5000 con 0x7f795c0a3400 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f7979ffb640 10 client.4451.objecter ms_dispatch2 0x7f798c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f7979ffb640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f7979ffb640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 4 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f7979ffb640 15 client.4451.objecter _session_command_op_remove 6 1 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d2c0b64c0 con 0x7f0d2c0ba350 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0d20003c20 con 0x7f0d2c0ba350 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 10 monclient: dump: 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.166 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d2a7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.132+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0d20003df0 con 0x7f0d2c0ba350 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff073fff640 1 -- 10.20.193.21:0/3640225429 <== osd.15 v1:10.20.193.72:6801/4086098431 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7ff09c159270 con 0x7ff06c0a3510 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff073fff640 10 client.4450.objecter ms_dispatch2 0x7ff09c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff073fff640 10 client.4450.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff073fff640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 4 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff073fff640 15 client.4450.objecter _session_command_op_remove 15 2 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7f0d2bfff640 10 monclient: get_auth_request con 0x7f0cfc079fe0 auth_method 0 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 10 librados: watch_flush enter 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 10 librados: watch_flush exit 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 10 client.4450.objecter close_session for osd.15 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 >> v1:10.20.193.72:6801/4086098431 conn(0x7ff06c0a3510 legacy=0x7ff06c0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 20 client.4450.objecter put_session s=0x7ff06c0a2e60 osd=15 1 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 20 client.4450.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 10 client.4450.objecter successfully canceled tick 2026-02-25T15:01:19.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7f0d28ff9640 10 client.4465.objecter ms_handle_connect 0x7f0cfc079fe0 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff06c079fe0 legacy=0x7ff06c09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 10 monclient: shutdown 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 >> v1:10.20.193.31:6789/0 conn(0x7ff09c0ba350 legacy=0x7ff09c161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff09b7fe640 1 -- 10.20.193.21:0/3640225429 reap_dead start 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 shutdown_connections 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 >> 10.20.193.21:0/3640225429 conn(0x7ff09c0b7990 msgr2=0x7ff09c0b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 shutdown_connections 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 -- 10.20.193.21:0/3640225429 wait complete. 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.133+0000 7ff0a192e640 1 librados: shutdown 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0d20095d70 con 0x7f0d2c0ba350 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 10 client.4465.objecter ms_dispatch2 0x7f0d2c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 3 client.4465.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 3 client.4465.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 10 client.4465.objecter checking command 1 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter _get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 15 client.4465.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter _get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 15 client.4465.objecter _session_command_op_assign 12 1 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 4 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 10 client.4465.objecter _send_command 1 2026-02-25T15:01:19.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.21:6808/3798667347 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cfc0c5110 con 0x7f0cfc0a3510 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 20 client.4465.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f0d2005b340 con 0x7f0d2c0ba350 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d28ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51e0159660 con 0x7f51e00b9f80 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f51d40039b0 con 0x7f51e00b9f80 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51cffff640 4 set_mon_vals no callback set 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f51ce7fc640 10 monclient: dump: 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.134+0000 7f0d2b7fe640 10 monclient: get_auth_request con 0x7f0cfc0a3510 auth_method 0 2026-02-25T15:01:19.169 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.170 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.135+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f51d4003bc0 con 0x7f51e00b9f80 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.136+0000 7f0d28ff9640 10 client.4465.objecter ms_handle_connect 0x7f0cfc0a3510 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.136+0000 7f51e5c77640 10 monclient: get_auth_request con 0x7f51b0079f50 auth_method 0 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.136+0000 7f51ce7fc640 10 client.4478.objecter ms_handle_connect 0x7f51b0079f50 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbc0003950 con 0x7fbc000b9f80 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fbbf00033a0 con 0x7fbc000b9f80 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfcff9640 10 monclient: dump: 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.170 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.138+0000 7fbbfe7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fbbf00035b0 con 0x7fbc000b9f80 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 20 client.4451.objecter _get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 20 client.4451.objecter _get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 20 client.4451.objecter get_session s=0x7f795c0a2d50 osd=6 3 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 15 client.4451.objecter _session_command_op_assign 6 2 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 4 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 10 client.4451.objecter _send_command 2 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.139+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 --> v1:10.20.193.68:6808/359632495 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f798c05aa60 con 0x7f795c0a3400 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== osd.9 v1:10.20.193.31:6800/3462355980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f405c004430 con 0x7f403c0a3690 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7f4043fff640 10 client.4443.objecter ms_dispatch2 0x7f406c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7f4043fff640 10 client.4443.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7f4043fff640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 4 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7f4043fff640 15 client.4443.objecter _session_command_op_remove 9 1 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7fbbfffff640 10 monclient: get_auth_request con 0x7fbbd0079f90 auth_method 0 2026-02-25T15:01:19.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.140+0000 7fbbfcff9640 10 client.4457.objecter ms_handle_connect 0x7fbbd0079f90 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f51d4095a70 con 0x7f51e00b9f80 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 10 client.4478.objecter ms_dispatch2 0x7f51e0000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 3 client.4478.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 3 client.4478.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:19.172 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 10 client.4478.objecter checking command 1 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter _get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 15 client.4478.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter _get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 15 client.4478.objecter _session_command_op_assign 13 1 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 4 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 10 client.4478.objecter _send_command 1 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.31:6801/981225706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51b00c5080 con 0x7f51b00a3480 2026-02-25T15:01:19.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.141+0000 7f51ce7fc640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7979ffb640 1 -- 10.20.193.21:0/1280775389 <== osd.6 v1:10.20.193.68:6808/359632495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f798c05aa60 con 0x7f795c0a3400 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7979ffb640 10 client.4451.objecter ms_dispatch2 0x7f798c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7979ffb640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7979ffb640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 4 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f51e6478640 10 monclient: get_auth_request con 0x7f51b00a3480 auth_method 0 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7979ffb640 15 client.4451.objecter _session_command_op_remove 6 2 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 10 librados: watch_flush enter 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 10 librados: watch_flush exit 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 10 client.4451.objecter close_session for osd.6 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 >> v1:10.20.193.68:6808/359632495 conn(0x7f795c0a3400 legacy=0x7f795c0c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 20 client.4451.objecter put_session s=0x7f795c0a2d50 osd=6 1 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 10 client.4451.objecter successfully canceled tick 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 >> v1:10.20.193.72:6800/2463505645 conn(0x7f795c079ed0 legacy=0x7f795c09a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 10 monclient: shutdown 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 >> v1:10.20.193.68:6789/0 conn(0x7f798c057480 legacy=0x7f798c0b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7991ddd640 1 -- 10.20.193.21:0/1280775389 reap_dead start 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 shutdown_connections 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 >> 10.20.193.21:0/1280775389 conn(0x7f798c0b4090 msgr2=0x7f798c15d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 shutdown_connections 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 -- 10.20.193.21:0/1280775389 wait complete. 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.142+0000 7f7993867640 1 librados: shutdown 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== osd.14 v1:10.20.193.68:6804/3496291144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdd280c50e0 con 0x7fdd280a34e0 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fdd3b7fe640 10 client.4462.objecter ms_dispatch2 0x7fdd5c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fdd3b7fe640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fdd3b7fe640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 4 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fdd3b7fe640 15 client.4462.objecter _session_command_op_remove 14 1 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7f51ce7fc640 10 client.4478.objecter ms_handle_connect 0x7f51b00a3480 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fbbf0094790 con 0x7fbc000b9f80 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 10 client.4457.objecter ms_dispatch2 0x7fbc00000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 3 client.4457.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 3 client.4457.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f51d405b040 con 0x7f51e00b9f80 2026-02-25T15:01:19.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7f51ce7fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 10 client.4457.objecter checking command 1 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter _get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 15 client.4457.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter _get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 15 client.4457.objecter _session_command_op_assign 10 1 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 4 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 10 client.4457.objecter _send_command 1 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6800/3680498089 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbd00c50c0 con 0x7fbbd00a34c0 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 20 client.4457.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fbbf0059d60 con 0x7fbc000b9f80 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.143+0000 7fbbfcff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.144+0000 7fbc04b11640 10 monclient: get_auth_request con 0x7fbbd00a34c0 auth_method 0 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.145+0000 7fbbfcff9640 10 client.4457.objecter ms_handle_connect 0x7fbbd00a34c0 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.146+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== osd.2 v1:10.20.193.68:6812/3838375510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7b000c50b0 con 0x7f7b000a34b0 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.146+0000 7f7b07fff640 10 client.4469.objecter ms_dispatch2 0x7f7b30000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.146+0000 7f7b07fff640 10 client.4469.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.146+0000 7f7b07fff640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 4 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.146+0000 7f7b07fff640 15 client.4469.objecter _session_command_op_remove 2 1 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 10 client.4443.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 15 client.4443.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 20 client.4443.objecter _get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 20 client.4443.objecter _get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 15 client.4443.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 20 client.4443.objecter get_session s=0x7f403c0a2fe0 osd=9 3 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 15 client.4443.objecter _session_command_op_assign 9 2 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 4 2026-02-25T15:01:19.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 10 client.4443.objecter _send_command 2 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.147+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 --> v1:10.20.193.31:6800/3462355980 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f406c158840 con 0x7f403c0a3690 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f807804b790 con 0x7f80780ba350 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8068002a50 con 0x7f80780ba350 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80577fe640 10 monclient: dump: 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f80757fa640 4 set_mon_vals no callback set 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4043fff640 1 -- 10.20.193.21:0/2510164016 <== osd.9 v1:10.20.193.31:6800/3462355980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f406c158840 con 0x7f403c0a3690 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4043fff640 10 client.4443.objecter ms_dispatch2 0x7f406c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4043fff640 10 client.4443.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4043fff640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 4 2026-02-25T15:01:19.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4043fff640 15 client.4443.objecter _session_command_op_remove 9 2 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 10 librados: watch_flush enter 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 10 librados: watch_flush exit 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 10 client.4443.objecter close_session for osd.9 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 >> v1:10.20.193.31:6800/3462355980 conn(0x7f403c0a3690 legacy=0x7f403c0c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 20 client.4443.objecter put_session s=0x7f403c0a2fe0 osd=9 1 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 20 client.4443.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 10 client.4443.objecter successfully canceled tick 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 >> v1:10.20.193.72:6800/2463505645 conn(0x7f403c07a160 legacy=0x7f403c09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 10 monclient: shutdown 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 >> v1:10.20.193.21:6789/0 conn(0x7f406c159e40 legacy=0x7f406c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f406b7fe640 1 -- 10.20.193.21:0/2510164016 reap_dead start 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 shutdown_connections 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 >> 10.20.193.21:0/2510164016 conn(0x7f406c0b7780 msgr2=0x7f406c058460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== osd.8 v1:10.20.193.21:6800/3085828309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f98480c5210 con 0x7f98480a3570 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f986d7fa640 10 client.4456.objecter ms_dispatch2 0x7f9878000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f986d7fa640 10 client.4456.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f986d7fa640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 4 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f986d7fa640 15 client.4456.objecter _session_command_op_remove 8 1 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 shutdown_connections 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 -- 10.20.193.21:0/2510164016 wait complete. 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.150+0000 7f4071945640 1 librados: shutdown 2026-02-25T15:01:19.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.151+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f8068002c30 con 0x7f80780ba350 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.178 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.151+0000 7f8076ffd640 10 monclient: get_auth_request con 0x7f804407a090 auth_method 0 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 10 client.4463.objecter ms_handle_connect 0x7f804407a090 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 20 client.4462.objecter _get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 20 client.4462.objecter _get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 20 client.4462.objecter get_session s=0x7fdd280a2e30 osd=14 3 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 15 client.4462.objecter _session_command_op_assign 14 2 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 4 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 10 client.4462.objecter _send_command 2 2026-02-25T15:01:19.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 --> v1:10.20.193.68:6804/3496291144 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd5c0b8030 con 0x7fdd280a34e0 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f8068095c40 con 0x7f80780ba350 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 10 client.4463.objecter ms_dispatch2 0x7f8078000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 3 client.4463.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 3 client.4463.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 10 client.4463.objecter checking command 1 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter _get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 15 client.4463.objecter _session_command_op_remove -1 1 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter _get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 15 client.4463.objecter _session_command_op_assign 11 1 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 4 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 10 client.4463.objecter _send_command 1 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.72:6809/3875035713 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80440c5260 con 0x7f80440a35c0 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.152+0000 7f80577fe640 20 client.4463.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.153+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f806805b210 con 0x7f80780ba350 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.153+0000 7f80577fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.153+0000 7f80767fc640 10 monclient: get_auth_request con 0x7f80440a35c0 auth_method 0 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 10 client.4469.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 15 client.4469.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 20 client.4469.objecter _get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 20 client.4469.objecter _get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 15 client.4469.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 20 client.4469.objecter get_session s=0x7f7b000a2e00 osd=2 3 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 15 client.4469.objecter _session_command_op_assign 2 2 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 4 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 10 client.4469.objecter _send_command 2 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.154+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 --> v1:10.20.193.68:6812/3838375510 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b300b94f0 con 0x7f7b000a34b0 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7f80577fe640 10 client.4463.objecter ms_handle_connect 0x7f80440a35c0 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd3b7fe640 1 -- 10.20.193.21:0/2667080053 <== osd.14 v1:10.20.193.68:6804/3496291144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fdd5c0b8030 con 0x7fdd280a34e0 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd3b7fe640 10 client.4462.objecter ms_dispatch2 0x7fdd5c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd3b7fe640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd3b7fe640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 4 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd3b7fe640 15 client.4462.objecter _session_command_op_remove 14 2 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 10 librados: watch_flush enter 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 10 librados: watch_flush exit 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 10 client.4462.objecter close_session for osd.14 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 >> v1:10.20.193.68:6804/3496291144 conn(0x7fdd280a34e0 legacy=0x7fdd280c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 20 client.4462.objecter put_session s=0x7fdd280a2e30 osd=14 1 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 10 client.4462.objecter successfully canceled tick 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 >> v1:10.20.193.72:6800/2463505645 conn(0x7fdd28079fb0 legacy=0x7fdd2809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 10 monclient: shutdown 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 >> v1:10.20.193.31:6789/0 conn(0x7fdd5c15e580 legacy=0x7fdd5c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd5b7fe640 1 -- 10.20.193.21:0/2667080053 reap_dead start 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 shutdown_connections 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 >> 10.20.193.21:0/2667080053 conn(0x7fdd5c0b5300 msgr2=0x7fdd5c15c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 shutdown_connections 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 -- 10.20.193.21:0/2667080053 wait complete. 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.155+0000 7fdd6149d640 1 librados: shutdown 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.156+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== osd.12 v1:10.20.193.21:6808/3798667347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0cfc0c5110 con 0x7f0cfc0a3510 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.156+0000 7f0d28ff9640 10 client.4465.objecter ms_dispatch2 0x7f0d2c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.156+0000 7f0d28ff9640 10 client.4465.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.156+0000 7f0d28ff9640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 4 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.156+0000 7f0d28ff9640 15 client.4465.objecter _session_command_op_remove 12 1 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.157+0000 7f7b07fff640 1 -- 10.20.193.21:0/722344640 <== osd.2 v1:10.20.193.68:6812/3838375510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f7b300b94f0 con 0x7f7b000a34b0 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.157+0000 7f7b07fff640 10 client.4469.objecter ms_dispatch2 0x7f7b30000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.157+0000 7f7b07fff640 10 client.4469.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.157+0000 7f7b07fff640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 4 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.157+0000 7f7b07fff640 15 client.4469.objecter _session_command_op_remove 2 2 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 10 librados: watch_flush enter 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 10 librados: watch_flush exit 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 10 client.4469.objecter close_session for osd.2 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 >> v1:10.20.193.68:6812/3838375510 conn(0x7f7b000a34b0 legacy=0x7f7b000c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 20 client.4469.objecter put_session s=0x7f7b000a2e00 osd=2 1 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 20 client.4469.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 10 client.4469.objecter successfully canceled tick 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 10 client.4456.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 15 client.4456.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 20 client.4456.objecter _get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 20 client.4456.objecter _get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 15 client.4456.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 20 client.4456.objecter get_session s=0x7f98480a2ec0 osd=8 3 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 15 client.4456.objecter _session_command_op_assign 8 2 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 4 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 10 client.4456.objecter _send_command 2 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 --> v1:10.20.193.21:6800/3085828309 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9878161980 con 0x7f98480a3570 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 >> v1:10.20.193.72:6800/2463505645 conn(0x7f7b00079f80 legacy=0x7f7b0009a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 10 monclient: shutdown 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 >> v1:10.20.193.68:6789/0 conn(0x7f7b300585e0 legacy=0x7f7b300b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b2f7fe640 1 -- 10.20.193.21:0/722344640 reap_dead start 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 shutdown_connections 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 >> 10.20.193.21:0/722344640 conn(0x7f7b300b7990 msgr2=0x7f7b300b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 shutdown_connections 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 -- 10.20.193.21:0/722344640 wait complete. 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.158+0000 7f7b35a16640 1 librados: shutdown 2026-02-25T15:01:19.182 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:19.183 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f986d7fa640 1 -- 10.20.193.21:0/3835944837 <== osd.8 v1:10.20.193.21:6800/3085828309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f9878161980 con 0x7f98480a3570 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f986d7fa640 10 client.4456.objecter ms_dispatch2 0x7f9878000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f986d7fa640 10 client.4456.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f986d7fa640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 4 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f986d7fa640 15 client.4456.objecter _session_command_op_remove 8 2 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 10 librados: watch_flush enter 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 10 librados: watch_flush exit 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 10 client.4456.objecter close_session for osd.8 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 >> v1:10.20.193.21:6800/3085828309 conn(0x7f98480a3570 legacy=0x7f98480c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 20 client.4456.objecter put_session s=0x7f98480a2ec0 osd=8 1 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 20 client.4456.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 10 client.4456.objecter successfully canceled tick 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 >> v1:10.20.193.72:6800/2463505645 conn(0x7f984807a040 legacy=0x7f984809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 10 monclient: shutdown 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 >> v1:10.20.193.31:6789/0 conn(0x7f987815e280 legacy=0x7f9878149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987d069640 1 -- 10.20.193.21:0/3835944837 reap_dead start 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 shutdown_connections 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 >> 10.20.193.21:0/3835944837 conn(0x7f98780b7990 msgr2=0x7f98780b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 shutdown_connections 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 -- 10.20.193.21:0/3835944837 wait complete. 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.161+0000 7f987eaf3640 1 librados: shutdown 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.163+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== osd.13 v1:10.20.193.31:6801/981225706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f51b00c5080 con 0x7f51b00a3480 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.163+0000 7f51ce7fc640 10 client.4478.objecter ms_dispatch2 0x7f51e0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.163+0000 7f51ce7fc640 10 client.4478.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.163+0000 7f51ce7fc640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 4 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.163+0000 7f51ce7fc640 15 client.4478.objecter _session_command_op_remove 13 1 2026-02-25T15:01:19.184 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.184 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== osd.10 v1:10.20.193.68:6800/3680498089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fbbd00c50c0 con 0x7fbbd00a34c0 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7fbbfcff9640 10 client.4457.objecter ms_dispatch2 0x7fbc00000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7fbbfcff9640 10 client.4457.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7fbbfcff9640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 4 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7fbbfcff9640 15 client.4457.objecter _session_command_op_remove 10 1 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 10 client.4465.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 15 client.4465.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 20 client.4465.objecter _get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 20 client.4465.objecter _get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 15 client.4465.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 20 client.4465.objecter get_session s=0x7f0cfc0a2e60 osd=12 3 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 15 client.4465.objecter _session_command_op_assign 12 2 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 4 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 10 client.4465.objecter _send_command 2 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.165+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 --> v1:10.20.193.21:6808/3798667347 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d2c0b94f0 con 0x7f0cfc0a3510 2026-02-25T15:01:19.185 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:19.185 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d28ff9640 1 -- 10.20.193.21:0/646505531 <== osd.12 v1:10.20.193.21:6808/3798667347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f0d2c0b94f0 con 0x7f0cfc0a3510 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d28ff9640 10 client.4465.objecter ms_dispatch2 0x7f0d2c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d28ff9640 10 client.4465.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d28ff9640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 4 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d28ff9640 15 client.4465.objecter _session_command_op_remove 12 2 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 10 librados: watch_flush enter 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 10 librados: watch_flush exit 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 10 client.4465.objecter close_session for osd.12 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 >> v1:10.20.193.21:6808/3798667347 conn(0x7f0cfc0a3510 legacy=0x7f0cfc0c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 20 client.4465.objecter put_session s=0x7f0cfc0a2e60 osd=12 1 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 20 client.4465.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 10 client.4465.objecter successfully canceled tick 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 >> v1:10.20.193.72:6800/2463505645 conn(0x7f0cfc079fe0 legacy=0x7f0cfc09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 10 monclient: shutdown 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 >> v1:10.20.193.31:6789/0 conn(0x7f0d2c0ba350 legacy=0x7f0d2c165df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d30a3c640 1 -- 10.20.193.21:0/646505531 reap_dead start 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 shutdown_connections 2026-02-25T15:01:19.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 >> 10.20.193.21:0/646505531 conn(0x7f0d2c0b7990 msgr2=0x7f0d2c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.168+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 shutdown_connections 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.169+0000 7f0d324c6640 1 -- 10.20.193.21:0/646505531 wait complete. 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.169+0000 7f0d324c6640 1 librados: shutdown 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stdout:90194313221 2026-02-25T15:01:19.187 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 10 client.4478.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 15 client.4478.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 20 client.4478.objecter _get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 20 client.4478.objecter _get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 15 client.4478.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 20 client.4478.objecter get_session s=0x7f51b00a2dd0 osd=13 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 15 client.4478.objecter _session_command_op_assign 13 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 4 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 10 client.4478.objecter _send_command 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.171+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 --> v1:10.20.193.31:6801/981225706 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51e0159380 con 0x7f51b00a3480 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 10 client.4457.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 15 client.4457.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 20 client.4457.objecter _get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 20 client.4457.objecter _get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 15 client.4457.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 20 client.4457.objecter get_session s=0x7fbbd00a2e10 osd=10 3 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 15 client.4457.objecter _session_command_op_assign 10 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 4 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 10 client.4457.objecter _send_command 2 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.173+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 --> v1:10.20.193.68:6800/3680498089 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbc0002a80 con 0x7fbbd00a34c0 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51ce7fc640 1 -- 10.20.193.21:0/1656549849 <== osd.13 v1:10.20.193.31:6801/981225706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7f51e0159380 con 0x7f51b00a3480 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51ce7fc640 10 client.4478.objecter ms_dispatch2 0x7f51e0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51ce7fc640 10 client.4478.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51ce7fc640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 4 2026-02-25T15:01:19.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51ce7fc640 15 client.4478.objecter _session_command_op_remove 13 2 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 10 librados: watch_flush enter 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 10 librados: watch_flush exit 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 10 client.4478.objecter close_session for osd.13 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 >> v1:10.20.193.31:6801/981225706 conn(0x7f51b00a3480 legacy=0x7f51b00c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 20 client.4478.objecter put_session s=0x7f51b00a2dd0 osd=13 1 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 10 client.4478.objecter successfully canceled tick 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 >> v1:10.20.193.72:6800/2463505645 conn(0x7f51b0079f50 legacy=0x7f51b009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 10 monclient: shutdown 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 >> v1:10.20.193.68:6789/0 conn(0x7f51e00b9f80 legacy=0x7f51e00b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e6478640 1 -- 10.20.193.21:0/1656549849 reap_dead start 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 shutdown_connections 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 >> 10.20.193.21:0/1656549849 conn(0x7f51e00b7990 msgr2=0x7f51e0157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== osd.11 v1:10.20.193.72:6809/3875035713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f80440c5260 con 0x7f80440a35c0 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f80577fe640 10 client.4463.objecter ms_dispatch2 0x7f8078000b90 command_reply(tid 1: 0 ) 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f80577fe640 10 client.4463.objecter _finish_command 1 = system:0 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f80577fe640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 4 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f80577fe640 15 client.4463.objecter _session_command_op_remove 11 1 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 shutdown_connections 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 -- 10.20.193.21:0/1656549849 wait complete. 2026-02-25T15:01:19.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.174+0000 7f51e7f02640 1 librados: shutdown 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbbfcff9640 1 -- 10.20.193.21:0/3838302500 <== osd.10 v1:10.20.193.68:6800/3680498089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fbbc0002a80 con 0x7fbbd00a34c0 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbbfcff9640 10 client.4457.objecter ms_dispatch2 0x7fbc00000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbbfcff9640 10 client.4457.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbbfcff9640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 4 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbbfcff9640 15 client.4457.objecter _session_command_op_remove 10 2 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 10 librados: watch_flush enter 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 10 librados: watch_flush exit 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 10 client.4457.objecter close_session for osd.10 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 >> v1:10.20.193.68:6800/3680498089 conn(0x7fbbd00a34c0 legacy=0x7fbbd00c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 20 client.4457.objecter put_session s=0x7fbbd00a2e10 osd=10 1 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 20 client.4457.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 10 client.4457.objecter successfully canceled tick 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 >> v1:10.20.193.72:6800/2463505645 conn(0x7fbbd0079f90 legacy=0x7fbbd009a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 10 monclient: shutdown 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 >> v1:10.20.193.68:6789/0 conn(0x7fbc000b9f80 legacy=0x7fbc001fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc04b11640 1 -- 10.20.193.21:0/3838302500 reap_dead start 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 shutdown_connections 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 >> 10.20.193.21:0/3838302500 conn(0x7fbc000b7990 msgr2=0x7fbc0015bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 shutdown_connections 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 -- 10.20.193.21:0/3838302500 wait complete. 2026-02-25T15:01:19.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.176+0000 7fbc0659b640 1 librados: shutdown 2026-02-25T15:01:19.191 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.191 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-25T15:01:19.191 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.191 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 10 client.4463.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 15 client.4463.objecter _session_command_op_assign -1 2 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 20 client.4463.objecter _get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 20 client.4463.objecter _get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 15 client.4463.objecter _session_command_op_remove -1 2 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 20 client.4463.objecter get_session s=0x7f80440a2f10 osd=11 3 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 15 client.4463.objecter _session_command_op_assign 11 2 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 4 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 10 client.4463.objecter _send_command 2 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.183+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 --> v1:10.20.193.72:6809/3875035713 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80780b94f0 con 0x7f80440a35c0 2026-02-25T15:01:19.192 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.192 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.185+0000 7f80577fe640 1 -- 10.20.193.21:0/467286427 <== osd.11 v1:10.20.193.72:6809/3875035713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f80780b94f0 con 0x7f80440a35c0 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.185+0000 7f80577fe640 10 client.4463.objecter ms_dispatch2 0x7f8078000b90 command_reply(tid 2: 0 ) 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.185+0000 7f80577fe640 10 client.4463.objecter _finish_command 2 = system:0 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.185+0000 7f80577fe640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 4 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.185+0000 7f80577fe640 15 client.4463.objecter _session_command_op_remove 11 2 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 10 librados: watch_flush enter 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 10 librados: watch_flush exit 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 10 client.4463.objecter close_session for osd.11 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 >> v1:10.20.193.72:6809/3875035713 conn(0x7f80440a35c0 legacy=0x7f80440c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 20 client.4463.objecter put_session s=0x7f80440a2f10 osd=11 1 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 20 client.4463.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 10 client.4463.objecter successfully canceled tick 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 >> v1:10.20.193.72:6800/2463505645 conn(0x7f804407a090 legacy=0x7f804409a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 10 monclient: shutdown 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 >> v1:10.20.193.68:6789/0 conn(0x7f80780ba350 legacy=0x7f80781fe4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f80777fe640 1 -- 10.20.193.21:0/467286427 reap_dead start 2026-02-25T15:01:19.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 shutdown_connections 2026-02-25T15:01:19.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 >> 10.20.193.21:0/467286427 conn(0x7f80780b7990 msgr2=0x7f80781594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 shutdown_connections 2026-02-25T15:01:19.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 -- 10.20.193.21:0/467286427 wait complete. 2026-02-25T15:01:19.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.186+0000 7f807d71a640 1 librados: shutdown 2026-02-25T15:01:19.199 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:19.199 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-25T15:01:19.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.229+0000 7ff6a33a9640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.229+0000 7ff6a33a9640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.229+0000 7ff6a33a9640 10 monclient: monmap: 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.230286+0000 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.230286+0000 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.231 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.230+0000 7ff6a33a9640 1 Processor -- start 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.230+0000 7ff6a33a9640 1 -- start start 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.230+0000 7ff6a33a9640 10 monclient: init 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-c con 0x7ff69c159a70 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-b con 0x7ff69c159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-a con 0x7ff69c058070 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c163930 con 0x7ff69c058070 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c163bf0 con 0x7ff69c159e40 2026-02-25T15:01:19.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c163ed0 con 0x7ff69c159a70 2026-02-25T15:01:19.233 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.233 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a33a9640 10 monclient(hunting): authenticate will time out at 3022.823475s 2026-02-25T15:01:19.233 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a111e640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff69c159a70 0x7ff69c0b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:53984/0 (socket says 10.20.193.21:53984) 2026-02-25T15:01:19.233 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.231+0000 7ff6a111e640 1 -- 10.20.193.21:0/2198360402 learned_addr learned my addr 10.20.193.21:0/2198360402 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772723703 0 0) 0x7ff69c163ed0 con 0x7ff69c159a70 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): my global_id is 4490 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff684003610 con 0x7ff69c159a70 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696965572 0 0) 0x7ff69c163bf0 con 0x7ff69c159e40 2026-02-25T15:01:19.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 10 monclient(hunting): my global_id is 4477 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.233+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c163ed0 con 0x7ff69c159e40 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264808995 0 0) 0x7ff69c163930 con 0x7ff69c058070 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 10 monclient(hunting): my global_id is 4449 2026-02-25T15:01:19.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.234+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c163bf0 con 0x7ff69c058070 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 267545986 0 0) 0x7ff684003610 con 0x7ff69c159a70 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 >> v1:10.20.193.31:6789/0 conn(0x7ff69c159e40 legacy=0x7ff69c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 >> v1:10.20.193.21:6789/0 conn(0x7ff69c058070 legacy=0x7ff69c058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c057590 con 0x7ff69c159a70 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff68c002df0 con 0x7ff69c159a70 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff68bfff640 10 monclient: dump: 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.236 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff6a33a9640 5 monclient: authenticate success, global_id 4490 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.235+0000 7ff6a33a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff68c002fc0 con 0x7ff69c159a70 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 1 -- 10.20.193.21:0/2198360402 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff68c003400 con 0x7ff69c159a70 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff68bfff640 10 monclient: dump: 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 4 set_mon_vals no callback set 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 10 monclient: shutdown 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2198360402 >> v1:10.20.193.68:6789/0 conn(0x7ff69c159a70 legacy=0x7ff69c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.236+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2198360402 shutdown_connections 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.237+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2198360402 >> 10.20.193.21:0/2198360402 conn(0x7ff69c0b7780 msgr2=0x7ff69c0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.237+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2198360402 shutdown_connections 2026-02-25T15:01:19.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.237+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2198360402 wait complete. 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.237+0000 7ff6a33a9640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.237+0000 7ff6a33a9640 10 monclient: monmap: 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.239 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 librados: starting msgr at 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 librados: starting objecter 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 Processor -- start 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 -- start start 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 librados: setting wanted keys 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 1 librados: calling monclient init 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.238+0000 7ff6a33a9640 10 monclient: init 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-c con 0x7ff69c058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-b con 0x7ff69c159a70 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient(hunting): picked mon.noname-a con 0x7ff69c159e40 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1fc5e0 con 0x7ff69c159e40 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1fc8c0 con 0x7ff69c159a70 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff69c1fcba0 con 0x7ff69c058070 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a33a9640 10 monclient(hunting): authenticate will time out at 3022.831319s 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a111e640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff69c058070 0x7ff69c1fe7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:53988/0 (socket says 10.20.193.21:53988) 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff6a111e640 1 -- 10.20.193.21:0/2739197558 learned_addr learned my addr 10.20.193.21:0/2739197558 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter ms_handle_connect 0x7ff69c058070 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter ms_handle_connect 0x7ff69c159a70 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter ms_handle_connect 0x7ff69c159e40 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.239+0000 7ff689ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7f678a98a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7f678a98a640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7f678a98a640 10 monclient: monmap: 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.241067+0000 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.241067+0000 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.241 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914264552 0 0) 0x7ff69c1fcba0 con 0x7ff69c058070 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 10 monclient(hunting): my global_id is 4493 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c003610 con 0x7ff69c058070 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872026018 0 0) 0x7ff69c1fc8c0 con 0x7ff69c159a70 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): my global_id is 4480 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c1fcba0 con 0x7ff69c159a70 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.240+0000 7f678a98a640 1 Processor -- start 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7f678a98a640 1 -- start start 2026-02-25T15:01:19.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7f678a98a640 10 monclient: init 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151369560 0 0) 0x7ff69c1fc5e0 con 0x7ff69c159e40 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 10 monclient(hunting): my global_id is 4452 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.241+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff69c1fc8c0 con 0x7ff69c159e40 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-b con 0x7f67840b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-c con 0x7f67840ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-a con 0x7f67840585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6784163930 con 0x7f67840585e0 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6784163bb0 con 0x7f67840b9f80 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6784163e90 con 0x7f67840ba350 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.242+0000 7f678a98a640 10 monclient(hunting): authenticate will time out at 3022.834300s 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1550772050 0 0) 0x7ff66c003610 con 0x7ff69c058070 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff69c1fc5e0 con 0x7ff69c058070 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff68c003310 con 0x7ff69c058070 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.244 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7f67837fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f67840ba350 0x7f6784057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54004/0 (socket says 10.20.193.21:54004) 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7f67837fe640 1 -- 10.20.193.21:0/354252994 learned_addr learned my addr 10.20.193.21:0/354252994 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1414531666 0 0) 0x7ff69c1fcba0 con 0x7ff69c159a70 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff66c003610 con 0x7ff69c159a70 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff690003040 con 0x7ff69c159a70 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.243+0000 7ff689ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.245 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.245+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4057713420 0 0) 0x7ff69c1fc5e0 con 0x7ff69c058070 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.245+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 >> v1:10.20.193.31:6789/0 conn(0x7ff69c159a70 legacy=0x7ff69c1fd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.245+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 >> v1:10.20.193.21:6789/0 conn(0x7ff69c159e40 legacy=0x7ff69c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.245+0000 7ff689ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.245+0000 7ff689ffb640 1 monclient: found mon.c 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69c1fce80 con 0x7ff69c058070 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff689ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 5 monclient: authenticate success, global_id 4493 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 10 monclient: _renew_subs 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff69c1fd160 con 0x7ff69c058070 2026-02-25T15:01:19.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 10 client.4493.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 927779526 0 0) 0x7f6784163e90 con 0x7f67840ba350 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 10 monclient(hunting): my global_id is 4496 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 10 monclient: _renew_subs 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6768003610 con 0x7f67840ba350 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466820434 0 0) 0x7f6784163bb0 con 0x7f67840b9f80 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 10 monclient(hunting): my global_id is 4483 2026-02-25T15:01:19.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6784163e90 con 0x7f67840b9f80 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff69c1feec0 con 0x7ff69c058070 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.246+0000 7ff6a33a9640 1 librados: init done 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7ff6a33a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7ff6a33a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7ff6a33a9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.247+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69c159220 con 0x7ff69c058070 2026-02-25T15:01:19.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 855893055 0 0) 0x7f6784163e90 con 0x7f67840b9f80 2026-02-25T15:01:19.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 >> v1:10.20.193.68:6789/0 conn(0x7f67840ba350 legacy=0x7f6784057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 >> v1:10.20.193.21:6789/0 conn(0x7f67840585e0 legacy=0x7f6784166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 monclient: found mon.noname-b 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840573f0 con 0x7f67840b9f80 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6770002df0 con 0x7f67840b9f80 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f678a98a640 5 monclient: authenticate success, global_id 4483 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f678a98a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f6782ffd640 10 monclient: dump: 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.249+0000 7f678a98a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6770003080 con 0x7f67840b9f80 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 1 -- 10.20.193.21:0/354252994 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f67700034c0 con 0x7f67840b9f80 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f678a98a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f678a98a640 4 set_mon_vals no callback set 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.250+0000 7f6782ffd640 10 monclient: dump: 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 10 monclient: shutdown 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 1 -- 10.20.193.21:0/354252994 >> v1:10.20.193.31:6789/0 conn(0x7f67840b9f80 legacy=0x7f6784163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 1 -- 10.20.193.21:0/354252994 shutdown_connections 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 1 -- 10.20.193.21:0/354252994 >> 10.20.193.21:0/354252994 conn(0x7f67840b7990 msgr2=0x7f67840b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 1 -- 10.20.193.21:0/354252994 shutdown_connections 2026-02-25T15:01:19.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.251+0000 7f678a98a640 1 -- 10.20.193.21:0/354252994 wait complete. 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.252+0000 7f678a98a640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.252+0000 7f678a98a640 10 monclient: monmap: 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.253 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 librados: starting msgr at 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 librados: starting objecter 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 Processor -- start 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 -- start start 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 librados: setting wanted keys 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 1 librados: calling monclient init 2026-02-25T15:01:19.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.253+0000 7f678a98a640 10 monclient: init 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-b con 0x7f67840585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-c con 0x7f67840b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient(hunting): picked mon.noname-a con 0x7f67840ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67841fd0f0 con 0x7f67840ba350 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67841fd3d0 con 0x7f67840585e0 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67841fd6b0 con 0x7f67840b9f80 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.255 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f678a98a640 10 monclient(hunting): authenticate will time out at 3022.846413s 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f069395c640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f069395c640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f069395c640 10 monclient: monmap: 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.255567+0000 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.255567+0000 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f6783fff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f67840585e0 0x7f67840b4bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47052/0 (socket says 10.20.193.21:47052) 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.254+0000 7f6783fff640 1 -- 10.20.193.21:0/769371737 learned_addr learned my addr 10.20.193.21:0/769371737 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f6780ff9640 10 client.?.objecter ms_handle_connect 0x7f67840585e0 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f6780ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f6780ff9640 10 client.?.objecter ms_handle_connect 0x7f67840ba350 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f6780ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f069395c640 1 Processor -- start 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f069395c640 1 -- start start 2026-02-25T15:01:19.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.255+0000 7f069395c640 10 monclient: init 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18322637 0 0) 0x7f67841fd3d0 con 0x7f67840585e0 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 10 monclient(hunting): my global_id is 4486 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6754003610 con 0x7f67840585e0 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient(hunting): picked mon.noname-c con 0x7f068c159a70 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient(hunting): picked mon.noname-b con 0x7f068c159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient(hunting): picked mon.noname-a con 0x7f068c058070 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c163930 con 0x7f068c058070 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c163bf0 con 0x7f068c159e40 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c163ed0 con 0x7f068c159a70 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.256+0000 7f069395c640 10 monclient(hunting): authenticate will time out at 3022.848790s 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1143260335 0 0) 0x7f67841fd0f0 con 0x7f67840ba350 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 10 monclient(hunting): my global_id is 4458 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67841fd3d0 con 0x7f67840ba350 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 10 monclient: monmap: 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.258067+0000 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.258067+0000 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.258 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f0691ed2640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f068c058070 0x7f068c058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46394/0 (socket says 10.20.193.21:46394) 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7f0691ed2640 1 -- 10.20.193.21:0/93098036 learned_addr learned my addr 10.20.193.21:0/93098036 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 1 Processor -- start 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 1 -- start start 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.257+0000 7fe86abb3640 10 monclient: init 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff68c0034b0 con 0x7ff69c058070 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff68c002f70 con 0x7ff69c058070 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff68b7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7ff689ffb640 10 monclient: dump: 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-a con 0x7fe8640b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-c con 0x7fe8640ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-b con 0x7fe8640585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864163930 con 0x7fe8640b9f80 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864163bb0 con 0x7fe8640585e0 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.258+0000 7fe86abb3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864163e90 con 0x7fe8640ba350 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7fe86abb3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.260 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7fe86abb3640 10 monclient(hunting): authenticate will time out at 3022.851031s 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3404376677 0 0) 0x7f6754003610 con 0x7f67840585e0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67841fd0f0 con 0x7f67840585e0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f67700033d0 con 0x7f67840585e0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7f6780ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff68c01dec0 con 0x7ff69c058070 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7fe869129640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe8640585e0 0x7fe864166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47080/0 (socket says 10.20.193.21:47080) 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.259+0000 7fe869129640 1 -- 10.20.193.21:0/306194933 learned_addr learned my addr 10.20.193.21:0/306194933 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff6a091d640 10 monclient: get_auth_request con 0x7ff66c07a0d0 auth_method 0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 10 client.4493.objecter ms_handle_connect 0x7ff66c07a0d0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7ff68c05ace0 con 0x7ff69c058070 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 10 client.4493.objecter ms_dispatch2 0x7ff69c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 3 client.4493.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 3 client.4493.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7ff689ffb640 20 client.4493.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007075984 0 0) 0x7f068c163930 con 0x7f068c058070 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 10 monclient(hunting): my global_id is 4461 2026-02-25T15:01:19.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.260+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0674003610 con 0x7f068c058070 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3229818509 0 0) 0x7f67841fd0f0 con 0x7f67840585e0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 >> v1:10.20.193.68:6789/0 conn(0x7f67840b9f80 legacy=0x7f67841f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 >> v1:10.20.193.21:6789/0 conn(0x7f67840ba350 legacy=0x7f6784161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 1 monclient: found mon.b 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67841fd990 con 0x7f67840585e0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f6780ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 5 monclient: authenticate success, global_id 4486 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 10 monclient: _renew_subs 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67841fdc70 con 0x7f67840585e0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 10 client.4486.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 10 monclient: _renew_subs 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f67841f9560 con 0x7f67840585e0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f678a98a640 1 librados: init done 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231889848 0 0) 0x7f068c163bf0 con 0x7f068c159e40 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 10 monclient(hunting): my global_id is 4489 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.262+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f068c163930 con 0x7f068c159e40 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7f678a98a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7f678a98a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7f678a98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.264 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67840b64c0 con 0x7f67840585e0 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028478149 0 0) 0x7fe864163bb0 con 0x7fe8640585e0 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 10 monclient(hunting): my global_id is 4492 2026-02-25T15:01:19.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.263+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003610 con 0x7fe8640585e0 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.266+0000 7f911efc3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.266+0000 7f911efc3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.266+0000 7f911efc3640 10 monclient: monmap: 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.267658+0000 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.267658+0000 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6770003020 con 0x7f67840585e0 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f6780ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f67827fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f911efc3640 1 Processor -- start 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f911efc3640 1 -- start start 2026-02-25T15:01:19.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f911efc3640 10 monclient: init 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2258514247 0 0) 0x7f0674003610 con 0x7f068c058070 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 >> v1:10.20.193.68:6789/0 conn(0x7f068c159a70 legacy=0x7f068c0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 >> v1:10.20.193.31:6789/0 conn(0x7f068c159e40 legacy=0x7f068c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c057590 con 0x7f068c058070 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f067bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f069395c640 5 monclient: authenticate success, global_id 4461 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7f069395c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7fe8511a2640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7fe8511a2640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.267+0000 7fe8511a2640 10 monclient: monmap: 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.268485+0000 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.268485+0000 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.269 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0688003170 con 0x7f068c058070 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f067bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f067bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f067bfff640 10 monclient: dump: 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f069395c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045218961 0 0) 0x7fe854002910 con 0x7fe8640b9f80 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 1 Processor -- start 2026-02-25T15:01:19.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 10 monclient(hunting): my global_id is 4464 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe864163bb0 con 0x7fe8640b9f80 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 1 -- start start 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 10 monclient: init 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-b con 0x7f9118157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-c con 0x7f9118157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-a con 0x7f9118164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911805de70 con 0x7f9118164d00 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9118055b20 con 0x7f9118157780 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9118055e00 con 0x7f9118157b50 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7f911efc3640 10 monclient(hunting): authenticate will time out at 3022.860492s 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-b con 0x7fe84c1566e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.268+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-a con 0x7fe84c160c00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-c con 0x7fe84c156ab0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c058480 con 0x7fe84c160c00 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c058760 con 0x7fe84c1566e0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c0b0f90 con 0x7fe84c156ab0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.269+0000 7fe8511a2640 10 monclient(hunting): authenticate will time out at 3022.861215s 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 10 monclient: monmap: 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.271813+0000 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.271813+0000 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1161797203 0 0) 0x7fe864163bb0 con 0x7fe8640b9f80 2026-02-25T15:01:19.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 1 Processor -- start 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 >> v1:10.20.193.68:6789/0 conn(0x7fe8640ba350 legacy=0x7fe864057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 >> v1:10.20.193.31:6789/0 conn(0x7fe8640585e0 legacy=0x7fe864166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640573f0 con 0x7fe8640b9f80 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06880033c0 con 0x7f068c058070 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 1 -- 10.20.193.21:0/93098036 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0688003800 con 0x7f068c058070 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f067bfff640 10 monclient: dump: 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.273 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f069395c640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f069395c640 4 set_mon_vals no callback set 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe854002fc0 con 0x7fe8640b9f80 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe22265b640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe22265b640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe22265b640 10 monclient: monmap: 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.272362+0000 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.272362+0000 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe86abb3640 5 monclient: authenticate success, global_id 4464 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe86abb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 1 -- start start 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7f3a444e8640 10 monclient: init 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe85b7fe640 10 monclient: dump: 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.271+0000 7fe86abb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f911d539640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9118164d00 0x7f91181c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46406/0 (socket says 10.20.193.21:46406) 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f911d539640 1 -- 10.20.193.21:0/3475267475 learned_addr learned my addr 10.20.193.21:0/3475267475 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-c con 0x7f3a3c159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-a con 0x7f3a3c165880 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-b con 0x7f3a3c056090 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 1 Processor -- start 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c15a170 con 0x7f3a3c165880 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c0b4650 con 0x7f3a3c056090 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c0b4930 con 0x7f3a3c159da0 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f3a444e8640 10 monclient(hunting): authenticate will time out at 3022.864230s 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 1 -- start start 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 10 monclient: init 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 10 monclient: shutdown 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 1 -- 10.20.193.21:0/93098036 >> v1:10.20.193.21:6789/0 conn(0x7f068c058070 legacy=0x7f068c058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 1 -- 10.20.193.21:0/93098036 shutdown_connections 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 1 -- 10.20.193.21:0/93098036 >> 10.20.193.21:0/93098036 conn(0x7f068c0b7780 msgr2=0x7f068c0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 1 -- 10.20.193.21:0/93098036 shutdown_connections 2026-02-25T15:01:19.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7f069395c640 1 -- 10.20.193.21:0/93098036 wait complete. 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-b con 0x7fe21c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.272+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-a con 0x7fe21c0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-c con 0x7fe21c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c163930 con 0x7fe21c0ba350 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c163bb0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c163e90 con 0x7fe21c0585e0 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe22265b640 10 monclient(hunting): authenticate will time out at 3022.865164s 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 10 monclient: monmap: 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 librados: starting msgr at 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 librados: starting objecter 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 Processor -- start 2026-02-25T15:01:19.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 -- start start 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 librados: setting wanted keys 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 1 librados: calling monclient init 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7f069395c640 10 monclient: init 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8540031d0 con 0x7fe8640b9f80 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe85b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe85b7fe640 1 -- 10.20.193.21:0/306194933 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe854003700 con 0x7fe8640b9f80 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe86abb3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.273+0000 7fe86abb3640 4 set_mon_vals no callback set 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe85b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe85b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe85b7fe640 10 monclient: dump: 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.278 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient(hunting): picked mon.noname-c con 0x7f068c058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient(hunting): picked mon.noname-a con 0x7f068c159a70 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient(hunting): picked mon.noname-b con 0x7f068c159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c1f8290 con 0x7f068c159a70 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c1f8570 con 0x7f068c159e40 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068c1f8850 con 0x7f068c058070 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f069395c640 10 monclient(hunting): authenticate will time out at 3022.866552s 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe86abb3640 10 monclient: shutdown 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe86abb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7fe86abb3640 1 -- 10.20.193.21:0/306194933 >> v1:10.20.193.21:6789/0 conn(0x7fe8640b9f80 legacy=0x7fe864163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f06326c6640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f06326c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.274+0000 7f06326c6640 10 monclient: monmap: 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.275416+0000 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.275416+0000 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.279 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 10 monclient: monmap: 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.275793+0000 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.275793+0000 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f3a41a5c640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f3a3c165880 0x7f3a3c055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46420/0 (socket says 10.20.193.21:46420) 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f3a41a5c640 1 -- 10.20.193.21:0/872307650 learned_addr learned my addr 10.20.193.21:0/872307650 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 1 -- 10.20.193.21:0/306194933 shutdown_connections 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 1 -- 10.20.193.21:0/306194933 >> 10.20.193.21:0/306194933 conn(0x7fe8640b7990 msgr2=0x7fe8640b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 1 -- 10.20.193.21:0/306194933 shutdown_connections 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 1 -- 10.20.193.21:0/306194933 wait complete. 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f06326c6640 1 Processor -- start 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 1 Processor -- start 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 1 -- start start 2026-02-25T15:01:19.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f125dbc8640 10 monclient: init 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f06326c6640 1 -- start start 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f06326c6640 10 monclient: init 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe84a575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe84c160c00 0x7fe84c057920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46418/0 (socket says 10.20.193.21:46418) 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe84a575640 1 -- 10.20.193.21:0/89718122 learned_addr learned my addr 10.20.193.21:0/89718122 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f0690ed0640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f068c159a70 0x7f068c0af690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46436/0 (socket says 10.20.193.21:46436) 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f0690ed0640 1 -- 10.20.193.21:0/4099611345 learned_addr learned my addr 10.20.193.21:0/4099611345 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7fe86abb3640 10 monclient: monmap: 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f05c3513640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f05c3513640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.275+0000 7f05c3513640 10 monclient: monmap: 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.276687+0000 2026-02-25T15:01:19.281 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.276687+0000 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f0679ffb640 10 client.?.objecter ms_handle_connect 0x7f068c159a70 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f0679ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-b con 0x7f1258159a70 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-a con 0x7f1258159e40 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-c con 0x7f1258058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1258163930 con 0x7f1258159e40 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1258163bf0 con 0x7f1258159a70 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1258163ed0 con 0x7f1258058070 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f125dbc8640 10 monclient(hunting): authenticate will time out at 3022.868243s 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 librados: starting msgr at 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-a con 0x7f062c0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-b con 0x7f062c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 librados: starting objecter 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-c con 0x7f062c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f05c3513640 1 Processor -- start 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c163930 con 0x7f062c0b9f80 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f05c3513640 1 -- start start 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f05c3513640 10 monclient: init 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c163bb0 con 0x7f062c0ba350 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 Processor -- start 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c163e90 con 0x7f062c0585e0 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.283 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7f06326c6640 10 monclient(hunting): authenticate will time out at 3022.868527s 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 -- start start 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 librados: setting wanted keys 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 1 librados: calling monclient init 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.276+0000 7fe86abb3640 10 monclient: init 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-c con 0x7f05bc0b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-a con 0x7f05bc0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-b con 0x7f05bc0585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc163930 con 0x7f05bc0ba350 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc163bb0 con 0x7f05bc0585e0 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc163e90 con 0x7f05bc0b9f80 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f05c3513640 10 monclient(hunting): authenticate will time out at 3022.869359s 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 10 monclient: monmap: 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.277946+0000 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.277946+0000 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.284 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-c con 0x7fe8640585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-a con 0x7fe8640b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient(hunting): picked mon.noname-b con 0x7fe8640ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe864166030 con 0x7fe8640b9f80 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8640b36c0 con 0x7fe8640ba350 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8640b39a0 con 0x7fe8640585e0 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7fe86abb3640 10 monclient(hunting): authenticate will time out at 3022.869474s 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 1 Processor -- start 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 1 -- start start 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.277+0000 7f810b99b640 10 monclient: init 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644189647 0 0) 0x7f068c1f8290 con 0x7f068c159a70 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 10 monclient(hunting): my global_id is 4470 2026-02-25T15:01:19.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f065c003610 con 0x7f068c159a70 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-c con 0x7f81040b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-b con 0x7f81040ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-a con 0x7f81040585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8104163930 con 0x7f81040585e0 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8104163bb0 con 0x7f81040ba350 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8104163e90 con 0x7f81040b9f80 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f810b99b640 10 monclient(hunting): authenticate will time out at 3022.870576s 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f05c0a87640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f05bc0ba350 0x7f05bc057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46458/0 (socket says 10.20.193.21:46458) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.278+0000 7f05c0a87640 1 -- 10.20.193.21:0/3948983319 learned_addr learned my addr 10.20.193.21:0/3948983319 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.280+0000 7fe21b7fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe21c0ba350 0x7fe21c057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46434/0 (socket says 10.20.193.21:46434) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.280+0000 7fe21b7fe640 1 -- 10.20.193.21:0/3093797936 learned_addr learned my addr 10.20.193.21:0/3093797936 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388620979 0 0) 0x7f911805de70 con 0x7f9118164d00 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 10 monclient(hunting): my global_id is 4467 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9104003610 con 0x7f9118164d00 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f1256ffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1258159e40 0x7f1258163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46440/0 (socket says 10.20.193.21:46440) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.281+0000 7f1256ffd640 1 -- 10.20.193.21:0/1600325307 learned_addr learned my addr 10.20.193.21:0/1600325307 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.286 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 10 monclient: monmap: 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.282873+0000 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.282873+0000 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335361500 0 0) 0x7f05b0002910 con 0x7f05bc0ba350 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 10 monclient(hunting): my global_id is 4479 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a4003610 con 0x7f05bc0ba350 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f062bfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f062c0b9f80 0x7f062c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46442/0 (socket says 10.20.193.21:46442) 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f062bfff640 1 -- 10.20.193.21:0/2401420751 learned_addr learned my addr 10.20.193.21:0/2401420751 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 1 Processor -- start 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 1 -- start start 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f69faae1640 10 monclient: init 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f8109f11640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f81040585e0 0x7f8104166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46476/0 (socket says 10.20.193.21:46476) 2026-02-25T15:01:19.287 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.282+0000 7f8109f11640 1 -- 10.20.193.21:0/4053771762 learned_addr learned my addr 10.20.193.21:0/4053771762 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 10 monclient: monmap: 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.283749+0000 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.283749+0000 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-b con 0x7f69f40b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-c con 0x7f69f40ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-a con 0x7f69f40585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f4163930 con 0x7f69f40585e0 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f4163bb0 con 0x7f69f40b9f80 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f4163e90 con 0x7f69f40ba350 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f69faae1640 10 monclient(hunting): authenticate will time out at 3022.875366s 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe85bfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe8640b9f80 0x7fe8640b4760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46474/0 (socket says 10.20.193.21:46474) 2026-02-25T15:01:19.288 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe85bfff640 1 -- 10.20.193.21:0/485170255 learned_addr learned my addr 10.20.193.21:0/485170255 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe4da344640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe4da344640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe4da344640 10 monclient: monmap: 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.284108+0000 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.284108+0000 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284316460 0 0) 0x7f3a3c15a170 con 0x7f3a3c165880 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 10 monclient(hunting): my global_id is 4476 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 1 Processor -- start 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a24003610 con 0x7f3a3c165880 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe8597fa640 10 client.?.objecter ms_handle_connect 0x7fe8640b9f80 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7fe8597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.289 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 1 Processor -- start 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 1 -- start start 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient: init 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 1 -- start start 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.283+0000 7f45dbb45640 10 monclient: init 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-b con 0x7f45d40b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-a con 0x7f45d40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-c con 0x7f45d40585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4163930 con 0x7f45d40ba350 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4163bb0 con 0x7f45d40b9f80 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4163e90 con 0x7f45d40585e0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7f45dbb45640 10 monclient(hunting): authenticate will time out at 3022.876368s 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-b con 0x7fe4d4155bc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-c con 0x7fe4d4155f90 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.284+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-a con 0x7fe4d40b27c0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.285+0000 7fe4da344640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d405c200 con 0x7fe4d40b27c0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.285+0000 7fe4da344640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d405c4e0 con 0x7fe4d4155bc0 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.285+0000 7fe4da344640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d405c7c0 con 0x7fe4d4155f90 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.285+0000 7fe4da344640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.290 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.285+0000 7fe4da344640 10 monclient(hunting): authenticate will time out at 3022.877115s 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7f45d90b9640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f45d40ba350 0x7f45d4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46504/0 (socket says 10.20.193.21:46504) 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7f45d90b9640 1 -- 10.20.193.21:0/2000244786 learned_addr learned my addr 10.20.193.21:0/2000244786 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381742479 0 0) 0x7fe84c058480 con 0x7fe84c160c00 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 10 monclient(hunting): my global_id is 4473 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.286+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe838003610 con 0x7fe84c160c00 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.288+0000 7f69f9057640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f69f40585e0 0x7f69f4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46492/0 (socket says 10.20.193.21:46492) 2026-02-25T15:01:19.291 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.288+0000 7f69f9057640 1 -- 10.20.193.21:0/4113944321 learned_addr learned my addr 10.20.193.21:0/4113944321 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734969814 0 0) 0x7f1258163930 con 0x7f1258159e40 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 10 monclient(hunting): my global_id is 4482 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.296+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f123c003610 con 0x7f1258159e40 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2240553096 0 0) 0x7f065c003610 con 0x7f068c159a70 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f068c1f8290 con 0x7f068c159a70 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0680003150 con 0x7f068c159a70 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.298 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f0679ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812254203 0 0) 0x7f45c8002910 con 0x7f45d40ba350 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 10 monclient(hunting): my global_id is 4494 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45bc003610 con 0x7f45d40ba350 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928153545 0 0) 0x7fe864166030 con 0x7fe8640b9f80 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 10 monclient(hunting): my global_id is 4488 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe834003610 con 0x7fe8640b9f80 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1015766385 0 0) 0x7f05a4003610 con 0x7f05bc0ba350 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 >> v1:10.20.193.68:6789/0 conn(0x7f05bc0b9f80 legacy=0x7f05bc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 >> v1:10.20.193.31:6789/0 conn(0x7f05bc0585e0 legacy=0x7f05bc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0573f0 con 0x7f05bc0ba350 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05b0002fc0 con 0x7f05bc0ba350 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05abfff640 10 monclient: dump: 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05c3513640 5 monclient: authenticate success, global_id 4479 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f05c3513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212813764 0 0) 0x7f0618002910 con 0x7f062c0b9f80 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 10 monclient(hunting): my global_id is 4485 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0610003610 con 0x7f062c0b9f80 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374716355 0 0) 0x7f8100002c90 con 0x7f81040585e0 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 10 monclient(hunting): my global_id is 4491 2026-02-25T15:01:19.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80ec003610 con 0x7f81040585e0 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2241543755 0 0) 0x7f9104003610 con 0x7f9118164d00 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 >> v1:10.20.193.68:6789/0 conn(0x7f9118157b50 legacy=0x7f91181645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 >> v1:10.20.193.31:6789/0 conn(0x7f9118157780 legacy=0x7f9118056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f910f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.297+0000 7f910f7fe640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91180560e0 con 0x7f9118164d00 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f911efc3640 5 monclient: authenticate success, global_id 4467 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f911efc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9114003170 con 0x7f9118164d00 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f910f7fe640 10 monclient: dump: 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f911efc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3852539151 0 0) 0x7f3a24003610 con 0x7f3a3c165880 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 >> v1:10.20.193.68:6789/0 conn(0x7f3a3c159da0 legacy=0x7f3a3c165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 >> v1:10.20.193.31:6789/0 conn(0x7f3a3c056090 legacy=0x7f3a3c0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c0b4c10 con 0x7f3a3c165880 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3a30002df0 con 0x7f3a3c165880 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a444e8640 5 monclient: authenticate success, global_id 4476 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a444e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a4125b640 10 monclient: dump: 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7f3a444e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839839866 0 0) 0x7fe20c002910 con 0x7fe21c0ba350 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 10 monclient(hunting): my global_id is 4497 2026-02-25T15:01:19.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe200003610 con 0x7fe21c0ba350 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe4d88ba640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe4d40b27c0 0x7fe4d41c3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46508/0 (socket says 10.20.193.21:46508) 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.298+0000 7fe4d88ba640 1 -- 10.20.193.21:0/1201022475 learned_addr learned my addr 10.20.193.21:0/1201022475 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122167703 0 0) 0x7f69f0002c90 con 0x7f69f40585e0 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 10 monclient(hunting): my global_id is 4500 2026-02-25T15:01:19.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.299+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003610 con 0x7f69f40585e0 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 385372124 0 0) 0x7f068c1f8290 con 0x7f068c159a70 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 >> v1:10.20.193.68:6789/0 conn(0x7f068c058070 legacy=0x7f068c1fa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 >> v1:10.20.193.31:6789/0 conn(0x7f068c159e40 legacy=0x7f068c15fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 1 monclient: found mon.a 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068c1f8b30 con 0x7f068c159a70 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f0679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 5 monclient: authenticate success, global_id 4470 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _renew_subs 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f068c1f8e10 con 0x7f068c159a70 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _renew_subs 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f068c160360 con 0x7f068c159a70 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 1 librados: init done 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.303+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068c158340 con 0x7f068c159a70 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 10 monclient: get_monmap_and_config 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 10 monclient: monmap: 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:19.304877+0000 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:19.304877+0000 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 1 Processor -- start 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 1 -- start start 2026-02-25T15:01:19.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7f877c616640 10 monclient: init 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3652923729 0 0) 0x7fe838003610 con 0x7fe84c160c00 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 >> v1:10.20.193.68:6789/0 conn(0x7fe84c156ab0 legacy=0x7fe84c055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 >> v1:10.20.193.31:6789/0 conn(0x7fe84c1566e0 legacy=0x7fe84c0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c0b1270 con 0x7fe84c160c00 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe834002df0 con 0x7fe84c160c00 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe849d74640 10 monclient: dump: 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe8511a2640 5 monclient: authenticate success, global_id 4473 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.304+0000 7fe8511a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient(hunting): picked mon.noname-a con 0x7f8774157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient(hunting): picked mon.noname-c con 0x7f8774157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient(hunting): picked mon.noname-b con 0x7f8774164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 53380003 0 0) 0x7f45bc003610 con 0x7f45d40ba350 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 >> v1:10.20.193.68:6789/0 conn(0x7f45d40585e0 legacy=0x7f45d4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 >> v1:10.20.193.31:6789/0 conn(0x7f45d40b9f80 legacy=0x7f45d4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40573f0 con 0x7f45d40ba350 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f45c8002fc0 con 0x7f45d40ba350 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45d88b8640 10 monclient: dump: 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.307 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877405de70 con 0x7f8774157780 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8774055b20 con 0x7f8774164d00 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8774055e00 con 0x7f8774157b50 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45dbb45640 5 monclient: authenticate success, global_id 4494 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f45dbb45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.305+0000 7f877c616640 10 monclient(hunting): authenticate will time out at 3022.897348s 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b00031d0 con 0x7f05bc0ba350 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 1 -- 10.20.193.21:0/3948983319 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05b0004990 con 0x7f05bc0ba350 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05abfff640 10 monclient: dump: 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.308 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 4 set_mon_vals no callback set 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 10 monclient: shutdown 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 1 -- 10.20.193.21:0/3948983319 >> v1:10.20.193.21:6789/0 conn(0x7f05bc0ba350 legacy=0x7f05bc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 1 -- 10.20.193.21:0/3948983319 shutdown_connections 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.307+0000 7f05c3513640 1 -- 10.20.193.21:0/3948983319 >> 10.20.193.21:0/3948983319 conn(0x7f05bc0b7990 msgr2=0x7f05bc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 -- 10.20.193.21:0/3948983319 shutdown_connections 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 -- 10.20.193.21:0/3948983319 wait complete. 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6770003c30 con 0x7f67840585e0 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f6780ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f6780ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f6780ff9640 10 monclient: dump: 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.309 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 10 monclient: monmap: 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 librados: starting msgr at 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 librados: starting objecter 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 Processor -- start 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 -- start start 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 librados: setting wanted keys 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 1 librados: calling monclient init 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.308+0000 7f05c3513640 10 monclient: init 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-b con 0x7f05bc0585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-a con 0x7f05bc0b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient(hunting): picked mon.noname-c con 0x7f05bc0ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc1febd0 con 0x7f05bc0b9f80 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0b3100 con 0x7f05bc0585e0 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05bc0b33e0 con 0x7f05bc0ba350 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.309+0000 7f05c3513640 10 monclient(hunting): authenticate will time out at 3022.901216s 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a30003000 con 0x7f3a3c165880 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 1 -- 10.20.193.21:0/872307650 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3a30003440 con 0x7f3a3c165880 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a4125b640 10 monclient: dump: 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.313 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a444e8640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.312+0000 7f3a444e8640 4 set_mon_vals no callback set 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 10 monclient: shutdown 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 -- 10.20.193.21:0/872307650 >> v1:10.20.193.21:6789/0 conn(0x7f3a3c165880 legacy=0x7f3a3c055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 -- 10.20.193.21:0/872307650 shutdown_connections 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 -- 10.20.193.21:0/872307650 >> 10.20.193.21:0/872307650 conn(0x7f3a3c0b78c0 msgr2=0x7f3a3c0b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 -- 10.20.193.21:0/872307650 shutdown_connections 2026-02-25T15:01:19.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 -- 10.20.193.21:0/872307650 wait complete. 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 10 monclient: monmap: 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 librados: starting msgr at 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.313+0000 7f3a444e8640 1 librados: starting objecter 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 Processor -- start 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 -- start start 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 librados: setting wanted keys 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 librados: calling monclient init 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient: init 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-b con 0x7f3a3c056090 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-c con 0x7f3a3c159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient(hunting): picked mon.noname-a con 0x7f3a3c165880 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c137150 con 0x7f3a3c165880 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c0ba290 con 0x7f3a3c056090 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c140260 con 0x7f3a3c159da0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f3a444e8640 10 monclient(hunting): authenticate will time out at 3022.906439s 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3942009131 0 0) 0x7f80ec003610 con 0x7f81040585e0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 >> v1:10.20.193.68:6789/0 conn(0x7f81040b9f80 legacy=0x7f8104163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 >> v1:10.20.193.31:6789/0 conn(0x7f81040ba350 legacy=0x7f8104057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81040573f0 con 0x7f81040585e0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8100003340 con 0x7f81040585e0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f80f3fff640 10 monclient: dump: 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f810b99b640 5 monclient: authenticate success, global_id 4491 2026-02-25T15:01:19.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f810b99b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f05c0a87640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f05bc0b9f80 0x7f05bc1fe4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46538/0 (socket says 10.20.193.21:46538) 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.314+0000 7f05c0a87640 1 -- 10.20.193.21:0/1707863770 learned_addr learned my addr 10.20.193.21:0/1707863770 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2183733520 0 0) 0x7f0610003610 con 0x7f062c0b9f80 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 >> v1:10.20.193.68:6789/0 conn(0x7f062c0585e0 legacy=0x7f062c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 >> v1:10.20.193.31:6789/0 conn(0x7f062c0ba350 legacy=0x7f062c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c0573f0 con 0x7f062c0b9f80 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0618002fc0 con 0x7f062c0b9f80 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f062affd640 10 monclient: dump: 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f06326c6640 5 monclient: authenticate success, global_id 4485 2026-02-25T15:01:19.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f06326c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f05a9ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0b9f80 2026-02-25T15:01:19.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.315+0000 7f05a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.343+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7ff68c05f450 con 0x7ff69c058070 2026-02-25T15:01:19.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.343+0000 7ff689ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.343+0000 7ff689ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 926184710 0 0) 0x7fe200003610 con 0x7fe21c0ba350 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 >> v1:10.20.193.68:6789/0 conn(0x7fe21c0585e0 legacy=0x7fe21c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 >> v1:10.20.193.31:6789/0 conn(0x7fe21c0b9f80 legacy=0x7fe21c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 monclient: found mon.noname-a 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0573f0 con 0x7fe21c0ba350 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe20c002fc0 con 0x7fe21c0ba350 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe21affd640 10 monclient: dump: 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe22265b640 5 monclient: authenticate success, global_id 4497 2026-02-25T15:01:19.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.345+0000 7fe22265b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.349+0000 7fe8597fa640 10 client.?.objecter ms_handle_connect 0x7fe8640585e0 2026-02-25T15:01:19.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.349+0000 7fe8597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.354+0000 7f3a41a5c640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3a3c159da0 0x7f3a3c137600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54186/0 (socket says 10.20.193.21:54186) 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.354+0000 7f3a41a5c640 1 -- 10.20.193.21:0/1427274138 learned_addr learned my addr 10.20.193.21:0/1427274138 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.354+0000 7f8779b8a640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8774157b50 0x7f87741645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54178/0 (socket says 10.20.193.21:54178) 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.354+0000 7f8779b8a640 1 -- 10.20.193.21:0/3968110692 learned_addr learned my addr 10.20.193.21:0/3968110692 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.355+0000 7f3a22ffd640 10 client.?.objecter ms_handle_connect 0x7f3a3c159da0 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.355+0000 7f3a22ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.355+0000 7f05a9ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0ba350 2026-02-25T15:01:19.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.355+0000 7f05a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213663580 0 0) 0x7f1258163ed0 con 0x7f1258058070 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 10 monclient(hunting): my global_id is 4499 2026-02-25T15:01:19.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.357+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258163930 con 0x7f1258058070 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148704746 0 0) 0x7fe8640b39a0 con 0x7fe8640585e0 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 10 monclient(hunting): my global_id is 4502 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.358+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe864166030 con 0x7fe8640585e0 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833406799 0 0) 0x7fe4d405c7c0 con 0x7fe4d4155f90 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 10 monclient(hunting): my global_id is 4508 2026-02-25T15:01:19.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b8003610 con 0x7fe4d4155f90 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701015090 0 0) 0x7f8774055e00 con 0x7f8774157b50 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 10 monclient(hunting): my global_id is 4514 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f875c003610 con 0x7f8774157b50 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984343475 0 0) 0x7f3a3c140260 con 0x7f3a3c159da0 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 10 monclient(hunting): my global_id is 4517 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.359+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a0c003610 con 0x7f3a3c159da0 2026-02-25T15:01:19.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f6770003e50 con 0x7f67840585e0 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166859511 0 0) 0x7f69f4163e90 con 0x7f69f40ba350 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 10 monclient(hunting): my global_id is 4505 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f0002c90 con 0x7f69f40ba350 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943384355 0 0) 0x7f05bc0b33e0 con 0x7f05bc0ba350 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 10 monclient(hunting): my global_id is 4511 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.360+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f058c003610 con 0x7f05bc0ba350 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.361+0000 7f67837fe640 10 monclient: get_auth_request con 0x7f6754079ea0 auth_method 0 2026-02-25T15:01:19.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.361+0000 7f6780ff9640 10 client.4486.objecter ms_handle_connect 0x7f6754079ea0 2026-02-25T15:01:19.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.362+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f6770095d40 con 0x7f67840585e0 2026-02-25T15:01:19.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.362+0000 7f6780ff9640 10 client.4486.objecter ms_dispatch2 0x7f6784000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.362+0000 7f6780ff9640 3 client.4486.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.362+0000 7f6780ff9640 3 client.4486.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.362+0000 7f6780ff9640 20 client.4486.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.363+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f677005f6a0 con 0x7f67840585e0 2026-02-25T15:01:19.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.363+0000 7f6780ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.363+0000 7f6780ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1456262130 0 0) 0x7f3a0c003610 con 0x7f3a3c159da0 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a3c140260 con 0x7f3a3c159da0 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3a30003390 con 0x7f3a3c159da0 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.370 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f3a22ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3300382628 0 0) 0x7f69f0002c90 con 0x7f69f40ba350 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 >> v1:10.20.193.31:6789/0 conn(0x7f69f40b9f80 legacy=0x7f69f4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 >> v1:10.20.193.21:6789/0 conn(0x7f69f40585e0 legacy=0x7f69f4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f40573f0 con 0x7f69f40ba350 2026-02-25T15:01:19.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f69dc002df0 con 0x7f69f40ba350 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69eb7fe640 10 monclient: dump: 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69faae1640 5 monclient: authenticate success, global_id 4505 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.369+0000 7f69faae1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.370+0000 7fe8597fa640 10 client.?.objecter ms_handle_connect 0x7fe8640ba350 2026-02-25T15:01:19.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.370+0000 7fe8597fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996717801 0 0) 0x7f1258163930 con 0x7f1258058070 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 >> v1:10.20.193.31:6789/0 conn(0x7f1258159a70 legacy=0x7f12580b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 >> v1:10.20.193.21:6789/0 conn(0x7f1258159e40 legacy=0x7f1258163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1258057590 con 0x7f1258058070 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f124c003170 con 0x7f1258058070 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f12567fc640 10 monclient: dump: 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f125dbc8640 5 monclient: authenticate success, global_id 4499 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.371+0000 7f125dbc8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1809630435 0 0) 0x7fe864166030 con 0x7fe8640585e0 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8640b39a0 con 0x7fe8640585e0 2026-02-25T15:01:19.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe854003380 con 0x7fe8640585e0 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7fe8597fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7f3a22ffd640 10 client.?.objecter ms_handle_connect 0x7f3a3c056090 2026-02-25T15:01:19.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.372+0000 7f3a22ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 460109810 0 0) 0x7fe4b8003610 con 0x7fe4d4155f90 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 >> v1:10.20.193.31:6789/0 conn(0x7fe4d4155bc0 legacy=0x7fe4d40b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 >> v1:10.20.193.21:6789/0 conn(0x7fe4d40b27c0 legacy=0x7fe4d41c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d405caa0 con 0x7fe4d4155f90 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe4c4002df0 con 0x7fe4d4155f90 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4d2ffd640 10 monclient: dump: 2026-02-25T15:01:19.376 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4da344640 5 monclient: authenticate success, global_id 4508 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.373+0000 7fe4da344640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 408788825 0 0) 0x7f058c003610 con 0x7f05bc0ba350 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05bc0b33e0 con 0x7f05bc0ba350 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05b8003240 con 0x7f05bc0ba350 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.377 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.374+0000 7f05a9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2559955300 0 0) 0x7f3a3c140260 con 0x7f3a3c159da0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 >> v1:10.20.193.31:6789/0 conn(0x7f3a3c056090 legacy=0x7f3a3c0b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 >> v1:10.20.193.21:6789/0 conn(0x7f3a3c165880 legacy=0x7f3a3c0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 1 monclient: found mon.c 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c140540 con 0x7f3a3c159da0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 5 monclient: authenticate success, global_id 4517 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _renew_subs 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c140820 con 0x7f3a3c159da0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 client.4517.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _renew_subs 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a3c140de0 con 0x7f3a3c159da0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 1 librados: init done 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.375+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c0b1d20 con 0x7f3a3c159da0 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409000482 0 0) 0x7fe8640b36c0 con 0x7fe8640ba350 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 10 monclient(hunting): my global_id is 4501 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe864166030 con 0x7fe8640ba350 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7f05a9ffb640 10 client.?.objecter ms_handle_connect 0x7f05bc0585e0 2026-02-25T15:01:19.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.377+0000 7f05a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 708252246 0 0) 0x7fe864166030 con 0x7fe8640ba350 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8640b36c0 con 0x7fe8640ba350 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe860003400 con 0x7fe8640ba350 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.381+0000 7fe8597fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.383 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69dc003000 con 0x7f69f40ba350 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 1 -- 10.20.193.21:0/4113944321 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f69dc003440 con 0x7f69f40ba350 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 4 set_mon_vals no callback set 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69eb7fe640 10 monclient: dump: 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.384 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.385 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.385 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.385 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 10 monclient: shutdown 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 1 -- 10.20.193.21:0/4113944321 >> v1:10.20.193.68:6789/0 conn(0x7f69f40ba350 legacy=0x7f69f4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 1 -- 10.20.193.21:0/4113944321 shutdown_connections 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 1 -- 10.20.193.21:0/4113944321 >> 10.20.193.21:0/4113944321 conn(0x7f69f40b7990 msgr2=0x7f69f40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 1 -- 10.20.193.21:0/4113944321 shutdown_connections 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 1 -- 10.20.193.21:0/4113944321 wait complete. 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.383+0000 7f69faae1640 10 monclient: monmap: 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 librados: starting msgr at 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 librados: starting objecter 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 Processor -- start 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 -- start start 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 librados: setting wanted keys 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 librados: calling monclient init 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient: init 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-a con 0x7f69f40585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-b con 0x7f69f40b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient(hunting): picked mon.noname-c con 0x7f69f40ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f41fc940 con 0x7f69f40585e0 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f41fcc20 con 0x7f69f40b9f80 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f41fcf00 con 0x7f69f40ba350 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.384+0000 7f69faae1640 10 monclient(hunting): authenticate will time out at 3022.976737s 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916660713 0 0) 0x7f8774055b20 con 0x7f8774164d00 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 10 monclient(hunting): my global_id is 4507 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8774055e00 con 0x7f8774164d00 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3028452253 0 0) 0x7fe8640b36c0 con 0x7fe8640ba350 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 >> v1:10.20.193.68:6789/0 conn(0x7fe8640585e0 legacy=0x7fe864165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 >> v1:10.20.193.21:6789/0 conn(0x7fe8640b9f80 legacy=0x7fe8640b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 1 monclient: found mon.b 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640b3c80 con 0x7fe8640ba350 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe8597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 5 monclient: authenticate success, global_id 4501 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _renew_subs 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8640b3f60 con 0x7fe8640ba350 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 client.4501.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _renew_subs 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8640b4e70 con 0x7fe8640ba350 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 1 librados: init done 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1971646715 0 0) 0x7f05bc0b3100 con 0x7f05bc0585e0 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 10 monclient(hunting): my global_id is 4510 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f058c003610 con 0x7f05bc0585e0 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.385+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8640b64c0 con 0x7fe8640ba350 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f69ebfff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f69f40b9f80 0x7f69f41fdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47234/0 (socket says 10.20.193.21:47234) 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f69ebfff640 1 -- 10.20.193.21:0/1873453879 learned_addr learned my addr 10.20.193.21:0/1873453879 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a30004bc0 con 0x7f3a3c159da0 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3a30004fd0 con 0x7f3a3c159da0 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a22ffd640 10 monclient: dump: 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.390 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f3a40a5a640 4 set_mon_vals no callback set 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1734404722 0 0) 0x7f875c003610 con 0x7f8774157b50 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 >> v1:10.20.193.31:6789/0 conn(0x7f8774164d00 legacy=0x7f87741c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 >> v1:10.20.193.21:6789/0 conn(0x7f8774157780 legacy=0x7f8774056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 1 monclient: found mon.noname-c 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87740560e0 con 0x7f8774157b50 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.386+0000 7f8779389640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8768002df0 con 0x7f8774157b50 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f8779389640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f8779389640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f8779389640 10 monclient: dump: 2026-02-25T15:01:19.391 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f877c616640 5 monclient: authenticate success, global_id 4514 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f877c616640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 409403398 0 0) 0x7f05bc0b33e0 con 0x7f05bc0ba350 2026-02-25T15:01:19.392 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 >> v1:10.20.193.31:6789/0 conn(0x7f05bc0585e0 legacy=0x7f05bc0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 >> v1:10.20.193.21:6789/0 conn(0x7f05bc0b9f80 legacy=0x7f05bc1fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 1 monclient: found mon.c 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05bc0b36c0 con 0x7f05bc0ba350 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 5 monclient: authenticate success, global_id 4511 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _renew_subs 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc161270 con 0x7f05bc0ba350 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 client.4511.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _renew_subs 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05bc162180 con 0x7f05bc0ba350 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 1 librados: init done 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc0b91d0 con 0x7f05bc0ba350 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.387+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3a300051b0 con 0x7f3a3c159da0 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a4225d640 10 monclient: get_auth_request con 0x7f3a0c079e40 auth_method 0 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a22ffd640 10 client.4517.objecter ms_handle_connect 0x7f3a0c079e40 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f3a30095bf0 con 0x7f3a3c159da0 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a22ffd640 10 client.4517.objecter ms_dispatch2 0x7f3a3c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a22ffd640 3 client.4517.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.388+0000 7f3a22ffd640 3 client.4517.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f124c003380 con 0x7f1258058070 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 1 -- 10.20.193.21:0/1600325307 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f124c0037c0 con 0x7f1258058070 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f12567fc640 10 monclient: dump: 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 4 set_mon_vals no callback set 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f3a22ffd640 20 client.4517.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 10 monclient: shutdown 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 1 -- 10.20.193.21:0/1600325307 >> v1:10.20.193.68:6789/0 conn(0x7f1258058070 legacy=0x7f1258058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 1 -- 10.20.193.21:0/1600325307 shutdown_connections 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 1 -- 10.20.193.21:0/1600325307 >> 10.20.193.21:0/1600325307 conn(0x7f12580b7780 msgr2=0x7f12580b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 1 -- 10.20.193.21:0/1600325307 shutdown_connections 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.389+0000 7f125dbc8640 1 -- 10.20.193.21:0/1600325307 wait complete. 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient: monmap: 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.395 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4c4003000 con 0x7fe4d4155f90 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 1 -- 10.20.193.21:0/1201022475 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe4c4003400 con 0x7fe4d4155f90 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4d2ffd640 10 monclient: dump: 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.396 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 4 set_mon_vals no callback set 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 librados: starting msgr at 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 librados: starting objecter 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 Processor -- start 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 -- start start 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 librados: setting wanted keys 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 librados: calling monclient init 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient: init 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 10 monclient: shutdown 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 1 -- 10.20.193.21:0/1201022475 >> v1:10.20.193.68:6789/0 conn(0x7fe4d4155f90 legacy=0x7fe4d4059990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-c con 0x7f1258058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-a con 0x7f1258159a70 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 1 -- 10.20.193.21:0/1201022475 shutdown_connections 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient(hunting): picked mon.noname-b con 0x7f1258159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 1 -- 10.20.193.21:0/1201022475 >> 10.20.193.21:0/1201022475 conn(0x7fe4d40b7120 msgr2=0x7fe4d40b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12581fc360 con 0x7f1258159a70 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12581fc640 con 0x7f1258159e40 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12581fc920 con 0x7f1258058070 2026-02-25T15:01:19.398 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7f125dbc8640 10 monclient(hunting): authenticate will time out at 3022.982776s 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 1 -- 10.20.193.21:0/1201022475 shutdown_connections 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.390+0000 7fe4da344640 1 -- 10.20.193.21:0/1201022475 wait complete. 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 10 monclient: monmap: 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.399 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 librados: starting msgr at 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 librados: starting objecter 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 Processor -- start 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 -- start start 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 librados: setting wanted keys 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 1 librados: calling monclient init 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.391+0000 7fe4da344640 10 monclient: init 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-b con 0x7fe4d40b27c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-c con 0x7fe4d4155bc0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient(hunting): picked mon.noname-a con 0x7fe4d4155f90 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d4136e30 con 0x7fe4d4155f90 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d41fc490 con 0x7fe4d40b27c0 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d41fc770 con 0x7fe4d4155bc0 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.392+0000 7fe4da344640 10 monclient(hunting): authenticate will time out at 3022.984368s 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9114003380 con 0x7f9118164d00 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 1 -- 10.20.193.21:0/3475267475 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f91140037c0 con 0x7f9118164d00 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f911efc3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f911efc3640 4 set_mon_vals no callback set 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.409+0000 7f910f7fe640 10 monclient: dump: 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.411 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 10 monclient: shutdown 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 1 -- 10.20.193.21:0/3475267475 >> v1:10.20.193.21:6789/0 conn(0x7f9118164d00 legacy=0x7f91181c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 1 -- 10.20.193.21:0/3475267475 shutdown_connections 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 1 -- 10.20.193.21:0/3475267475 >> 10.20.193.21:0/3475267475 conn(0x7f91180b2ef0 msgr2=0x7f91180b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 1 -- 10.20.193.21:0/3475267475 shutdown_connections 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 1 -- 10.20.193.21:0/3475267475 wait complete. 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.410+0000 7f911efc3640 10 monclient: monmap: 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.412 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 librados: starting msgr at 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 librados: starting objecter 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 Processor -- start 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 -- start start 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 librados: setting wanted keys 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 librados: calling monclient init 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient: init 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-a con 0x7f9118157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-b con 0x7f9118157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient(hunting): picked mon.noname-c con 0x7f9118164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91180ada80 con 0x7f9118157780 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91180add60 con 0x7f9118157b50 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91180ae040 con 0x7f9118164d00 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.413 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.411+0000 7f911efc3640 10 monclient(hunting): authenticate will time out at 3023.003627s 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0680003500 con 0x7f068c159a70 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0680003b90 con 0x7f068c159a70 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f0679ffb640 10 monclient: dump: 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.416 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.415+0000 7f067b7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.416+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0680003d70 con 0x7f068c159a70 2026-02-25T15:01:19.417 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.416+0000 7f06916d1640 10 monclient: get_auth_request con 0x7f065c079e00 auth_method 0 2026-02-25T15:01:19.418 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.416+0000 7f0679ffb640 10 client.4470.objecter ms_handle_connect 0x7f065c079e00 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0680095dd0 con 0x7f068c159a70 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 10 client.4470.objecter ms_dispatch2 0x7f068c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 3 client.4470.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 3 client.4470.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 20 client.4470.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f068005f730 con 0x7f068c159a70 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.420 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f0679ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe834003000 con 0x7fe84c160c00 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 1 -- 10.20.193.21:0/89718122 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe834003440 con 0x7fe84c160c00 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe8511a2640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe8511a2640 4 set_mon_vals no callback set 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7fe849d74640 10 monclient: dump: 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06180031d0 con 0x7f062c0b9f80 2026-02-25T15:01:19.421 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 1 -- 10.20.193.21:0/2401420751 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0618004990 con 0x7f062c0b9f80 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f062affd640 10 monclient: dump: 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f06326c6640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.419+0000 7f06326c6640 4 set_mon_vals no callback set 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45c80031d0 con 0x7f45d40ba350 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 1 -- 10.20.193.21:0/2000244786 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f45c8004990 con 0x7f45d40ba350 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45d88b8640 10 monclient: dump: 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.422 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 4 set_mon_vals no callback set 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 10 monclient: shutdown 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 1 -- 10.20.193.21:0/89718122 >> v1:10.20.193.21:6789/0 conn(0x7fe84c160c00 legacy=0x7fe84c057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 1 -- 10.20.193.21:0/89718122 shutdown_connections 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 1 -- 10.20.193.21:0/89718122 >> 10.20.193.21:0/89718122 conn(0x7fe84c0b2ef0 msgr2=0x7fe84c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 1 -- 10.20.193.21:0/89718122 shutdown_connections 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 1 -- 10.20.193.21:0/89718122 wait complete. 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f1256ffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1258159a70 0x7f1258161f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46550/0 (socket says 10.20.193.21:46550) 2026-02-25T15:01:19.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f1256ffd640 1 -- 10.20.193.21:0/89766823 learned_addr learned my addr 10.20.193.21:0/89766823 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 10 monclient: shutdown 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 1 -- 10.20.193.21:0/2401420751 >> v1:10.20.193.21:6789/0 conn(0x7f062c0b9f80 legacy=0x7f062c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 1 -- 10.20.193.21:0/2401420751 shutdown_connections 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 1 -- 10.20.193.21:0/2401420751 >> 10.20.193.21:0/2401420751 conn(0x7f062c0b7990 msgr2=0x7f062c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 1 -- 10.20.193.21:0/2401420751 shutdown_connections 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f06326c6640 1 -- 10.20.193.21:0/2401420751 wait complete. 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 10 monclient: shutdown 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 1 -- 10.20.193.21:0/2000244786 >> v1:10.20.193.21:6789/0 conn(0x7f45d40ba350 legacy=0x7f45d4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 1 -- 10.20.193.21:0/2000244786 shutdown_connections 2026-02-25T15:01:19.424 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 1 -- 10.20.193.21:0/2000244786 >> 10.20.193.21:0/2000244786 conn(0x7f45d40b7990 msgr2=0x7f45d40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 1 -- 10.20.193.21:0/2000244786 shutdown_connections 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7f45dbb45640 1 -- 10.20.193.21:0/2000244786 wait complete. 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.420+0000 7fe8511a2640 10 monclient: monmap: 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 librados: starting msgr at 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 librados: starting objecter 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 Processor -- start 2026-02-25T15:01:19.425 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 10 monclient: monmap: 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 -- start start 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 librados: setting wanted keys 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 librados: calling monclient init 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient: init 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f1233fff640 10 client.?.objecter ms_handle_connect 0x7f1258159a70 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f1233fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 librados: starting msgr at 2026-02-25T15:01:19.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 librados: starting objecter 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 Processor -- start 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 10 monclient: monmap: 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f69e97fa640 10 client.?.objecter ms_handle_connect 0x7f69f40585e0 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f69e97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 -- start start 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 librados: setting wanted keys 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 1 librados: calling monclient init 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 10 monclient: init 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-c con 0x7fe84c1566e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-a con 0x7fe84c156ab0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient(hunting): picked mon.noname-b con 0x7fe84c160c00 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c0ad7f0 con 0x7fe84c156ab0 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c13de20 con 0x7fe84c160c00 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c0ada60 con 0x7fe84c1566e0 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7fe8511a2640 10 monclient(hunting): authenticate will time out at 3023.013571s 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 librados: starting msgr at 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 librados: starting objecter 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 Processor -- start 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 -- start start 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 librados: setting wanted keys 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 1 librados: calling monclient init 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f45dbb45640 10 monclient: init 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.421+0000 7f06326c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-c con 0x7f062c0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-b con 0x7f062c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient(hunting): picked mon.noname-a con 0x7f062c0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c155880 con 0x7f062c0ba350 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c1fd090 con 0x7f062c0b9f80 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c1fd370 con 0x7f062c0585e0 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f06326c6640 10 monclient(hunting): authenticate will time out at 3023.014049s 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-b con 0x7f45d40585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-c con 0x7f45d40b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient(hunting): picked mon.noname-a con 0x7f45d40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d41febd0 con 0x7f45d40ba350 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40b3100 con 0x7f45d40585e0 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d40b33e0 con 0x7f45d40b9f80 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.422+0000 7f45dbb45640 10 monclient(hunting): authenticate will time out at 3023.014406s 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe20c0031d0 con 0x7fe21c0ba350 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 1 -- 10.20.193.21:0/3093797936 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe20c004990 con 0x7fe21c0ba350 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe21affd640 10 monclient: dump: 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.430 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe22265b640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe22265b640 4 set_mon_vals no callback set 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe4d88ba640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe4d4155f90 0x7fe4d41fba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46564/0 (socket says 10.20.193.21:46564) 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe4d88ba640 1 -- 10.20.193.21:0/3451815246 learned_addr learned my addr 10.20.193.21:0/3451815246 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe22265b640 10 monclient: shutdown 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe22265b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.423+0000 7fe22265b640 1 -- 10.20.193.21:0/3093797936 >> v1:10.20.193.21:6789/0 conn(0x7fe21c0ba350 legacy=0x7fe21c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 -- 10.20.193.21:0/3093797936 shutdown_connections 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 -- 10.20.193.21:0/3093797936 >> 10.20.193.21:0/3093797936 conn(0x7fe21c0b7990 msgr2=0x7fe21c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 -- 10.20.193.21:0/3093797936 shutdown_connections 2026-02-25T15:01:19.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 -- 10.20.193.21:0/3093797936 wait complete. 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe4d0ff9640 10 client.?.objecter ms_handle_connect 0x7fe4d4155f90 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe4d0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 10 monclient: monmap: 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.432 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 librados: starting msgr at 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 librados: starting objecter 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 Processor -- start 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 -- start start 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 librados: setting wanted keys 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 1 librados: calling monclient init 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.424+0000 7fe22265b640 10 monclient: init 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-a con 0x7fe21c0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-c con 0x7fe21c0b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient(hunting): picked mon.noname-b con 0x7fe21c0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c1febd0 con 0x7fe21c0585e0 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0b3100 con 0x7fe21c0ba350 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c0b33e0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7fe22265b640 10 monclient(hunting): authenticate will time out at 3023.017429s 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060885667 0 0) 0x7f12581fc360 con 0x7f1258159a70 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 10 monclient(hunting): my global_id is 4509 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.425+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1228003610 con 0x7f1258159a70 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8100003550 con 0x7f81040585e0 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 1 -- 10.20.193.21:0/4053771762 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8100004d10 con 0x7f81040585e0 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f80f3fff640 10 monclient: dump: 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 4 set_mon_vals no callback set 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 10 monclient: shutdown 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 1 -- 10.20.193.21:0/4053771762 >> v1:10.20.193.21:6789/0 conn(0x7f81040585e0 legacy=0x7f8104166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236175383 0 0) 0x7f69f41fc940 con 0x7f69f40585e0 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 10 monclient(hunting): my global_id is 4512 2026-02-25T15:01:19.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c4003610 con 0x7f69f40585e0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 1 -- 10.20.193.21:0/4053771762 shutdown_connections 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 1 -- 10.20.193.21:0/4053771762 >> 10.20.193.21:0/4053771762 conn(0x7f81040b7990 msgr2=0x7f81040b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 1 -- 10.20.193.21:0/4053771762 shutdown_connections 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.427+0000 7f810b99b640 1 -- 10.20.193.21:0/4053771762 wait complete. 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 10 monclient: monmap: 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 librados: starting msgr at 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 librados: starting objecter 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 Processor -- start 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 -- start start 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 librados: setting wanted keys 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 1 librados: calling monclient init 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.428+0000 7f810b99b640 10 monclient: init 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-a con 0x7f81040585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-b con 0x7f81040b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient(hunting): picked mon.noname-c con 0x7f81040ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81041febd0 con 0x7f81040585e0 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81040b3100 con 0x7f81040b9f80 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81040b33e0 con 0x7f81040ba350 2026-02-25T15:01:19.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.429+0000 7f810b99b640 10 monclient(hunting): authenticate will time out at 3023.021249s 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2973957231 0 0) 0x7f1228003610 con 0x7f1258159a70 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12581fc360 con 0x7f1258159a70 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f12480030b0 con 0x7f1258159a70 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.432+0000 7f1233fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212354095 0 0) 0x7fe4d4136e30 con 0x7fe4d4155f90 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 10 monclient(hunting): my global_id is 4515 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a4003610 con 0x7fe4d4155f90 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe84a575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe84c156ab0 0x7fe84c12d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46584/0 (socket says 10.20.193.21:46584) 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.434+0000 7fe84a575640 1 -- 10.20.193.21:0/1937177984 learned_addr learned my addr 10.20.193.21:0/1937177984 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.435+0000 7f911cd38640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9118157780 0x7f9118127470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46572/0 (socket says 10.20.193.21:46572) 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.435+0000 7f911cd38640 1 -- 10.20.193.21:0/1140116277 learned_addr learned my addr 10.20.193.21:0/1140116277 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.435+0000 7fe82b7fe640 10 client.?.objecter ms_handle_connect 0x7fe84c156ab0 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.436+0000 7fe82b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.436+0000 7f910d7fa640 10 client.?.objecter ms_handle_connect 0x7f9118157780 2026-02-25T15:01:19.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.436+0000 7f910d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7f0630c3c640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f062c0ba350 0x7f062c1f8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46598/0 (socket says 10.20.193.21:46598) 2026-02-25T15:01:19.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7f0630c3c640 1 -- 10.20.193.21:0/3809599525 learned_addr learned my addr 10.20.193.21:0/3809599525 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3893821475 0 0) 0x7fe4a4003610 con 0x7fe4d4155f90 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4d4136e30 con 0x7fe4d4155f90 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe4c8003310 con 0x7fe4d4155f90 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7fe4d0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7f0628ff9640 10 client.?.objecter ms_handle_connect 0x7f062c0ba350 2026-02-25T15:01:19.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.441+0000 7f0628ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.444+0000 7f45da0bb640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f45d40ba350 0x7f45d4161a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46600/0 (socket says 10.20.193.21:46600) 2026-02-25T15:01:19.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.444+0000 7f45da0bb640 1 -- 10.20.193.21:0/3137115742 learned_addr learned my addr 10.20.193.21:0/3137115742 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.445+0000 7fe21bfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe21c0585e0 0x7fe21c0b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46610/0 (socket says 10.20.193.21:46610) 2026-02-25T15:01:19.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.445+0000 7fe21bfff640 1 -- 10.20.193.21:0/173912398 learned_addr learned my addr 10.20.193.21:0/173912398 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7f45c27fc640 10 client.?.objecter ms_handle_connect 0x7f45d40ba350 2026-02-25T15:01:19.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7f45c27fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 661480954 0 0) 0x7fe4d4136e30 con 0x7fe4d4155f90 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 >> v1:10.20.193.68:6789/0 conn(0x7fe4d4155bc0 legacy=0x7fe4d4136720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 >> v1:10.20.193.31:6789/0 conn(0x7fe4d40b27c0 legacy=0x7fe4d41521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 1 monclient: found mon.a 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d41f8740 con 0x7fe4d4155f90 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 5 monclient: authenticate success, global_id 4515 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 10 monclient: _renew_subs 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d41f8a20 con 0x7fe4d4155f90 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 10 client.4515.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 10 monclient: _renew_subs 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe218ff9640 10 client.?.objecter ms_handle_connect 0x7fe21c0585e0 2026-02-25T15:01:19.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe218ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4d41fc180 con 0x7fe4d4155f90 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.446+0000 7fe4da344640 1 librados: init done 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.447+0000 7fe4da344640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.447+0000 7fe4da344640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.447+0000 7fe4da344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.447+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d4058d00 con 0x7fe4d4155f90 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f8109710640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f81040585e0 0x7f81040b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46622/0 (socket says 10.20.193.21:46622) 2026-02-25T15:01:19.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f8109710640 1 -- 10.20.193.21:0/1616331578 learned_addr learned my addr 10.20.193.21:0/1616331578 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1789546991 0 0) 0x7f69c4003610 con 0x7f69f40585e0 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69f41fc940 con 0x7f69f40585e0 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f69e4002f70 con 0x7f69f40585e0 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.448+0000 7f69e97fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209210406 0 0) 0x7f91180ada80 con 0x7f9118157780 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 10 monclient(hunting): my global_id is 4521 2026-02-25T15:01:19.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90e8003610 con 0x7f9118157780 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f80f1ffb640 10 client.?.objecter ms_handle_connect 0x7f81040585e0 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.449+0000 7f80f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4c8004c50 con 0x7fe4d4155f90 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe4c8004ec0 con 0x7fe4d4155f90 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d0ff9640 10 monclient: dump: 2026-02-25T15:01:19.451 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7fe4d27fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460242154 0 0) 0x7f062c155880 con 0x7f062c0ba350 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 10 monclient(hunting): my global_id is 4524 2026-02-25T15:01:19.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.450+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05fc003610 con 0x7f062c0ba350 2026-02-25T15:01:19.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.457+0000 7ff6a33a9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:19.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.457+0000 7ff6a33a9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:19.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.457+0000 7ff6a33a9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.457+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff69c163160 con 0x7ff69c058070 2026-02-25T15:01:19.475 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f69e97fa640 10 client.?.objecter ms_handle_connect 0x7f69f40b9f80 2026-02-25T15:01:19.475 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f69e97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f678a98a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:19.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f678a98a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:19.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f678a98a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.474+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f678415afd0 con 0x7f67840585e0 2026-02-25T15:01:19.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.475+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f3a30002fd0 con 0x7f3a3c159da0 2026-02-25T15:01:19.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.476+0000 7f3a22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.476+0000 7f3a22ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.477+0000 7f69e97fa640 10 client.?.objecter ms_handle_connect 0x7f69f40ba350 2026-02-25T15:01:19.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.477+0000 7f69e97fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8600038b0 con 0x7fe8640ba350 2026-02-25T15:01:19.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe860004df0 con 0x7fe8640ba350 2026-02-25T15:01:19.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe85affd640 4 set_mon_vals no callback set 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.478+0000 7fe8597fa640 10 monclient: dump: 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.479+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe86001e2d0 con 0x7fe8640ba350 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe860098160 con 0x7fe8640ba350 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 10 client.4501.objecter ms_dispatch2 0x7fe864000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 3 client.4501.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 3 client.4501.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 20 client.4501.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe868928640 10 monclient: get_auth_request con 0x7fe834079f80 auth_method 0 2026-02-25T15:01:19.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.480+0000 7fe8597fa640 10 client.4501.objecter ms_handle_connect 0x7fe834079f80 2026-02-25T15:01:19.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.481+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe86005f7e0 con 0x7fe8640ba350 2026-02-25T15:01:19.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.481+0000 7fe8597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.481+0000 7fe8597fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.484+0000 7f1233fff640 10 client.?.objecter ms_handle_connect 0x7f1258159e40 2026-02-25T15:01:19.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.484+0000 7f1233fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246027823 0 0) 0x7f69f41fcc20 con 0x7f69f40b9f80 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 10 monclient(hunting): my global_id is 4513 2026-02-25T15:01:19.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.485+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c4003610 con 0x7f69f40b9f80 2026-02-25T15:01:19.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.489+0000 7fe82b7fe640 10 client.?.objecter ms_handle_connect 0x7fe84c160c00 2026-02-25T15:01:19.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.489+0000 7fe82b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.489+0000 7f910d7fa640 10 client.?.objecter ms_handle_connect 0x7f9118157b50 2026-02-25T15:01:19.491 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.489+0000 7f910d7fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.491+0000 7f0628ff9640 10 client.?.objecter ms_handle_connect 0x7f062c0b9f80 2026-02-25T15:01:19.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.491+0000 7f0628ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.491+0000 7f45c27fc640 10 client.?.objecter ms_handle_connect 0x7f45d40585e0 2026-02-25T15:01:19.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.491+0000 7f45c27fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525231080 0 0) 0x7f12581fc640 con 0x7f1258159e40 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 10 monclient(hunting): my global_id is 4516 2026-02-25T15:01:19.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.494+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1228003610 con 0x7f1258159e40 2026-02-25T15:01:19.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7fe218ff9640 10 client.?.objecter ms_handle_connect 0x7fe21c0ba350 2026-02-25T15:01:19.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7fe218ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206647662 0 0) 0x7f91180add60 con 0x7f9118157b50 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 10 monclient(hunting): my global_id is 4519 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91180ada80 con 0x7f9118157b50 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f80f1ffb640 10 client.?.objecter ms_handle_connect 0x7f81040b9f80 2026-02-25T15:01:19.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f80f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399909521 0 0) 0x7f45d40b3100 con 0x7f45d40585e0 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 10 monclient(hunting): my global_id is 4528 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.496+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a4003610 con 0x7f45d40585e0 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7f6780ff9640 1 -- 10.20.193.21:0/769371737 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 778662779) 0x7f677005efa0 con 0x7f67840585e0 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7f6780ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:19.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7f6780ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111850540 0 0) 0x7fe84c13de20 con 0x7fe84c160c00 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 10 monclient(hunting): my global_id is 4522 2026-02-25T15:01:19.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.497+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe818003610 con 0x7fe84c160c00 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 10 librados: watch_flush enter 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 10 librados: watch_flush exit 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 20 client.4486.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 10 client.4486.objecter successfully canceled tick 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 >> v1:10.20.193.72:6800/2463505645 conn(0x7f6754079ea0 legacy=0x7f675409a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 10 monclient: shutdown 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 >> v1:10.20.193.31:6789/0 conn(0x7f67840585e0 legacy=0x7f67840b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 shutdown_connections 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 >> 10.20.193.21:0/769371737 conn(0x7f67840b7990 msgr2=0x7f678415b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 shutdown_connections 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 -- 10.20.193.21:0/769371737 wait complete. 2026-02-25T15:01:19.502 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f678a98a640 1 librados: shutdown 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1363812123 0 0) 0x7f69c4003610 con 0x7f69f40b9f80 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69f41fcc20 con 0x7f69f40b9f80 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f69dc003390 con 0x7f69f40b9f80 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.500+0000 7f69e97fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.503 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1478929100 0 0) 0x7f91180ada80 con 0x7f9118157b50 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91180add60 con 0x7f9118157b50 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9100002f70 con 0x7f9118157b50 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 10 monclient(hunting): dump: 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.505 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.501+0000 7f910d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366249996 0 0) 0x7f062c1fd090 con 0x7f062c0b9f80 2026-02-25T15:01:19.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 10 monclient(hunting): my global_id is 4525 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062c155880 con 0x7f062c0b9f80 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550068598 0 0) 0x7fe21c0b3100 con 0x7fe21c0ba350 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 10 monclient(hunting): my global_id is 4531 2026-02-25T15:01:19.510 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.508+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1ec003610 con 0x7fe21c0ba350 2026-02-25T15:01:19.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443770458 0 0) 0x7f81040b3100 con 0x7f81040b9f80 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 10 monclient(hunting): my global_id is 4534 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d4003610 con 0x7f81040b9f80 2026-02-25T15:01:19.513 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3304360622 0 0) 0x7f45a4003610 con 0x7f45d40585e0 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45d40b3100 con 0x7f45d40585e0 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f45c4002f70 con 0x7f45d40585e0 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.1 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 10 monclient(hunting): dump: 2026-02-25T15:01:19.514 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.511+0000 7f45c27fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.515 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 527852047 0 0) 0x7fe818003610 con 0x7fe84c160c00 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe84c13de20 con 0x7fe84c160c00 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe83c0031a0 con 0x7fe84c160c00 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.516 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.513+0000 7fe82b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1975042171 0 0) 0x7f91180add60 con 0x7f9118157b50 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 >> v1:10.20.193.68:6789/0 conn(0x7f9118164d00 legacy=0x7f9118148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 >> v1:10.20.193.21:6789/0 conn(0x7f9118157780 legacy=0x7f9118127470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 1 monclient: found mon.b 2026-02-25T15:01:19.519 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.517+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91180ae320 con 0x7f9118157b50 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f910d7fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f910d7fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f910d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 5 monclient: authenticate success, global_id 4519 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _renew_subs 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91180ae600 con 0x7f9118157b50 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 client.4519.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _renew_subs 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9118058070 con 0x7f9118157b50 2026-02-25T15:01:19.520 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 1 librados: init done 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.518+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91180b2c90 con 0x7f9118157b50 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2023038369 0 0) 0x7f45d40b3100 con 0x7f45d40585e0 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 >> v1:10.20.193.68:6789/0 conn(0x7f45d40b9f80 legacy=0x7f45d41fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 >> v1:10.20.193.21:6789/0 conn(0x7f45d40ba350 legacy=0x7f45d4161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.521 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 1 monclient: found mon.b 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40b36c0 con 0x7f45d40585e0 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 116879968 0 0) 0x7f69f41fcc20 con 0x7f69f40b9f80 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 >> v1:10.20.193.68:6789/0 conn(0x7f69f40ba350 legacy=0x7f69f4155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 5 monclient: authenticate success, global_id 4528 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 10 monclient: _renew_subs 2026-02-25T15:01:19.522 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45d4161270 con 0x7f45d40585e0 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 >> v1:10.20.193.21:6789/0 conn(0x7f69f40585e0 legacy=0x7f69f4165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 1 monclient: found mon.b 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f41fd1e0 con 0x7f69f40b9f80 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.523 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 5 monclient: authenticate success, global_id 4513 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 10 monclient: _renew_subs 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69f41fd4c0 con 0x7f69f40b9f80 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 10 client.4528.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 10 monclient: _renew_subs 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f45d4162180 con 0x7f45d40585e0 2026-02-25T15:01:19.524 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f45dbb45640 1 librados: init done 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 10 client.4513.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 10 monclient: _renew_subs 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f69f4163610 con 0x7f69f40b9f80 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f69faae1640 1 librados: init done 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4076317853 0 0) 0x7f1228003610 con 0x7f1258159e40 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12581fc640 con 0x7f1258159e40 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f124c0036d0 con 0x7f1258159e40 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.519+0000 7f1233fff640 10 monclient(hunting): dump: 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.525 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f69faae1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f69faae1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f69faae1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f45dbb45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f40b7fa0 con 0x7f69f40b9f80 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f45dbb45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f45dbb45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.520+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d40b64c0 con 0x7f45d40585e0 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 751162178 0 0) 0x7fe1ec003610 con 0x7fe21c0ba350 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe21c0b3100 con 0x7fe21c0ba350 2026-02-25T15:01:19.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe210003240 con 0x7fe21c0ba350 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.521+0000 7fe218ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3939849314 0 0) 0x7f062c155880 con 0x7f062c0b9f80 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f062c1fd090 con 0x7f062c0b9f80 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f061c002ed0 con 0x7f062c0b9f80 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.522+0000 7f0628ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.528+0000 7f069395c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:19.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.528+0000 7f069395c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:19.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.528+0000 7f069395c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.528+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f068c0b71c0 con 0x7f068c159a70 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908392888 0 0) 0x7fe84c0ad7f0 con 0x7fe84c156ab0 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 10 monclient(hunting): my global_id is 4518 2026-02-25T15:01:19.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe818003610 con 0x7fe84c156ab0 2026-02-25T15:01:19.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.545+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe4c80050a0 con 0x7fe4d4155f90 2026-02-25T15:01:19.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.546+0000 7fe4d3fff640 10 monclient: get_auth_request con 0x7fe4a4079ea0 auth_method 0 2026-02-25T15:01:19.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.546+0000 7fe4d0ff9640 10 client.4515.objecter ms_handle_connect 0x7fe4a4079ea0 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345408117 0 0) 0x7fe21c1febd0 con 0x7fe21c0585e0 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 10 monclient(hunting): my global_id is 4530 2026-02-25T15:01:19.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.550+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1ec003610 con 0x7fe21c0585e0 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.551+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe4c80960c0 con 0x7fe4d4155f90 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.551+0000 7fe4d0ff9640 10 client.4515.objecter ms_dispatch2 0x7fe4d4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.551+0000 7fe4d0ff9640 3 client.4515.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.551+0000 7fe4d0ff9640 3 client.4515.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.552+0000 7fe4d0ff9640 20 client.4515.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.552+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe4c805fa20 con 0x7fe4d4155f90 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.552+0000 7fe4d0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.552+0000 7fe4d0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.560+0000 7f0679ffb640 1 -- 10.20.193.21:0/4099611345 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 521551722) 0x7f068005f030 con 0x7f068c159a70 2026-02-25T15:01:19.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.560+0000 7f0679ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:19.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.560+0000 7f0679ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.562 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1059083873 0 0) 0x7f12581fc360 con 0x7f1258159a70 2026-02-25T15:01:19.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 >> v1:10.20.193.68:6789/0 conn(0x7f1258058070 legacy=0x7f12581fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 >> v1:10.20.193.31:6789/0 conn(0x7f1258159e40 legacy=0x7f125815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 1 monclient: found mon.a 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12581fcc00 con 0x7f1258159a70 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f1233fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 5 monclient: authenticate success, global_id 4509 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 10 monclient: _renew_subs 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f12581fcee0 con 0x7f1258159a70 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 10 client.4509.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 10 monclient: _renew_subs 2026-02-25T15:01:19.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f12581fdcf0 con 0x7f1258159a70 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.561+0000 7f125dbc8640 1 librados: init done 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164538497 0 0) 0x7f81041febd0 con 0x7f81040585e0 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 10 monclient(hunting): my global_id is 4533 2026-02-25T15:01:19.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81040b3100 con 0x7f81040585e0 2026-02-25T15:01:19.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f125dbc8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f125dbc8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f125dbc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.562+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1258156e00 con 0x7f1258159a70 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 10 librados: watch_flush enter 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 10 librados: watch_flush exit 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 20 client.4470.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 10 client.4470.objecter successfully canceled tick 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 >> v1:10.20.193.72:6800/2463505645 conn(0x7f065c079e00 legacy=0x7f065c09a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 10 monclient: shutdown 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 >> v1:10.20.193.21:6789/0 conn(0x7f068c159a70 legacy=0x7f068c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 shutdown_connections 2026-02-25T15:01:19.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 >> 10.20.193.21:0/4099611345 conn(0x7f068c0b7780 msgr2=0x7f068c158860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 shutdown_connections 2026-02-25T15:01:19.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 -- 10.20.193.21:0/4099611345 wait complete. 2026-02-25T15:01:19.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.563+0000 7f069395c640 1 librados: shutdown 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8768003000 con 0x7f8774157b50 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 1 -- 10.20.193.21:0/3968110692 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8768003440 con 0x7f8774157b50 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f8779389640 10 monclient: dump: 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.572 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f877c616640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:19.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.570+0000 7f877c616640 4 set_mon_vals no callback set 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 10 monclient: shutdown 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 1 -- 10.20.193.21:0/3968110692 >> v1:10.20.193.68:6789/0 conn(0x7f8774157b50 legacy=0x7f87741645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 1 -- 10.20.193.21:0/3968110692 shutdown_connections 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 1 -- 10.20.193.21:0/3968110692 >> 10.20.193.21:0/3968110692 conn(0x7f87740b2ef0 msgr2=0x7f87740b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 1 -- 10.20.193.21:0/3968110692 shutdown_connections 2026-02-25T15:01:19.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 1 -- 10.20.193.21:0/3968110692 wait complete. 2026-02-25T15:01:19.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7ff689ffb640 1 -- 10.20.193.21:0/2739197558 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 778662779) 0x7ff68c05ed50 con 0x7ff69c058070 2026-02-25T15:01:19.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7ff689ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:19.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7ff689ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.575 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:19.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 10 monclient: build_initial_monmap 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.571+0000 7f877c616640 10 monclient: monmap: 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:19.576 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.7 2026-02-25T15:01:19.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 librados: starting msgr at 2026-02-25T15:01:19.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 librados: starting objecter 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 Processor -- start 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 -- start start 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 librados: setting wanted keys 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 librados: calling monclient init 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient: init 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient(hunting): picked mon.noname-c con 0x7f8774157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient(hunting): picked mon.noname-b con 0x7f8774157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient(hunting): picked mon.noname-a con 0x7f8774164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877415d280 con 0x7f8774164d00 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877415bad0 con 0x7f8774157b50 2026-02-25T15:01:19.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877415bdb0 con 0x7f8774157780 2026-02-25T15:01:19.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:19.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.572+0000 7f877c616640 10 monclient(hunting): authenticate will time out at 3023.164572s 2026-02-25T15:01:19.580 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 10 librados: watch_flush enter 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 10 librados: watch_flush exit 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 20 client.4493.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 10 client.4493.objecter successfully canceled tick 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff66c07a0d0 legacy=0x7ff66c09a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 10 monclient: shutdown 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 >> v1:10.20.193.68:6789/0 conn(0x7ff69c058070 legacy=0x7ff69c1fe7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 shutdown_connections 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 >> 10.20.193.21:0/2739197558 conn(0x7ff69c0b7780 msgr2=0x7ff69c1582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 shutdown_connections 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 -- 10.20.193.21:0/2739197558 wait complete. 2026-02-25T15:01:19.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.574+0000 7ff6a33a9640 1 librados: shutdown 2026-02-25T15:01:19.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b80038c0 con 0x7f05bc0ba350 2026-02-25T15:01:19.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f05b8003c10 con 0x7f05bc0ba350 2026-02-25T15:01:19.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05a9ffb640 10 monclient: dump: 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.577+0000 7f05ab7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.578+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f05b801d0f0 con 0x7f05bc0ba350 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05c1288640 10 monclient: get_auth_request con 0x7f058c079fb0 auth_method 0 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 10 client.4511.objecter ms_handle_connect 0x7f058c079fb0 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f05b8094ce0 con 0x7f05bc0ba350 2026-02-25T15:01:19.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 10 client.4511.objecter ms_dispatch2 0x7f05bc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 3 client.4511.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 3 client.4511.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.579+0000 7f05a9ffb640 20 client.4511.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.580+0000 7f0628ff9640 10 client.?.objecter ms_handle_connect 0x7f062c0585e0 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.580+0000 7f0628ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.581+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f05b805e640 con 0x7f05bc0ba350 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.581+0000 7f05a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.581+0000 7f05a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.0 2026-02-25T15:01:19.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.583+0000 7f80f1ffb640 10 client.?.objecter ms_handle_connect 0x7f81040ba350 2026-02-25T15:01:19.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.583+0000 7f80f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.583+0000 7fe82b7fe640 10 client.?.objecter ms_handle_connect 0x7fe84c1566e0 2026-02-25T15:01:19.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.583+0000 7fe82b7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462350409 0 0) 0x7f062c1fd370 con 0x7f062c0585e0 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 10 monclient(hunting): my global_id is 4520 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.585+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f062c155880 con 0x7f062c0585e0 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7fe218ff9640 10 client.?.objecter ms_handle_connect 0x7fe21c0b9f80 2026-02-25T15:01:19.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7fe218ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807937746 0 0) 0x7f81040b33e0 con 0x7f81040ba350 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 10 monclient(hunting): my global_id is 4523 2026-02-25T15:01:19.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.586+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81041febd0 con 0x7f81040ba350 2026-02-25T15:01:19.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.588+0000 7f3a444e8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:19.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.588+0000 7f3a444e8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:19.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.588+0000 7f3a444e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.588+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f3a3c056980 con 0x7f3a3c159da0 2026-02-25T15:01:19.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1174997445 0 0) 0x7f062c155880 con 0x7f062c0585e0 2026-02-25T15:01:19.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f062c1fd370 con 0x7f062c0585e0 2026-02-25T15:01:19.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f06180028f0 con 0x7f062c0585e0 2026-02-25T15:01:19.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.590+0000 7f0628ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.592 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.591+0000 7f877a38b640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8774157780 0x7f877412e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54268/0 (socket says 10.20.193.21:54268) 2026-02-25T15:01:19.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.591+0000 7f877a38b640 1 -- 10.20.193.21:0/2710320832 learned_addr learned my addr 10.20.193.21:0/2710320832 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154650530 0 0) 0x7fe84c0ada60 con 0x7fe84c1566e0 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 10 monclient(hunting): my global_id is 4526 2026-02-25T15:01:19.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe84c0ad7f0 con 0x7fe84c1566e0 2026-02-25T15:01:19.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7f875affd640 10 client.?.objecter ms_handle_connect 0x7f8774157780 2026-02-25T15:01:19.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.593+0000 7f875affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330385983 0 0) 0x7fe21c0b33e0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 10 monclient(hunting): my global_id is 4529 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.594+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c1febd0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2780390193 0 0) 0x7f81041febd0 con 0x7f81040ba350 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81040b33e0 con 0x7f81040ba350 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8100002c70 con 0x7f81040ba350 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.597 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7f80f1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7fe86abb3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:19.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7fe86abb3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:19.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7fe86abb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.595+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe86413bcd0 con 0x7fe8640ba350 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543159201 0 0) 0x7f877415bdb0 con 0x7f8774157780 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 10 monclient(hunting): my global_id is 4532 2026-02-25T15:01:19.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.597+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8744003610 con 0x7f8774157780 2026-02-25T15:01:19.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.602+0000 7f3a22ffd640 1 -- 10.20.193.21:0/1427274138 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 778662779) 0x7f3a3005f550 con 0x7f3a3c159da0 2026-02-25T15:01:19.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.602+0000 7f3a22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:19.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.602+0000 7f3a22ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.604 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1639297455 0 0) 0x7f062c1fd370 con 0x7f062c0585e0 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 >> v1:10.20.193.31:6789/0 conn(0x7f062c0b9f80 legacy=0x7f062c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 >> v1:10.20.193.21:6789/0 conn(0x7f062c0ba350 legacy=0x7f062c1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 1 monclient: found mon.c 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c1fd650 con 0x7f062c0585e0 2026-02-25T15:01:19.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f0628ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 5 monclient: authenticate success, global_id 4520 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _renew_subs 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f062c1fd930 con 0x7f062c0585e0 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 client.4520.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _renew_subs 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f062c1f9510 con 0x7f062c0585e0 2026-02-25T15:01:19.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 1 librados: init done 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 174193253 0 0) 0x7f81040b33e0 con 0x7f81040ba350 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 >> v1:10.20.193.31:6789/0 conn(0x7f81040b9f80 legacy=0x7f81041fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 >> v1:10.20.193.21:6789/0 conn(0x7f81040585e0 legacy=0x7f81040b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 1 monclient: found mon.c 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81040b36c0 con 0x7f81040ba350 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f80f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 5 monclient: authenticate success, global_id 4523 2026-02-25T15:01:19.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 10 monclient: _renew_subs 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8104161270 con 0x7f81040ba350 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 10 monclient: _renew_subs 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8104162180 con 0x7f81040ba350 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f810b99b640 1 librados: init done 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.603+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c159080 con 0x7f062c0585e0 2026-02-25T15:01:19.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.604+0000 7f810b99b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.604+0000 7f810b99b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.604+0000 7f810b99b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.604+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81040b91d0 con 0x7f81040ba350 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 10 librados: watch_flush enter 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 10 librados: watch_flush exit 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 20 client.4517.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 10 client.4517.objecter successfully canceled tick 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3a0c079e40 legacy=0x7f3a0c09a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 10 monclient: shutdown 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 >> v1:10.20.193.68:6789/0 conn(0x7f3a3c159da0 legacy=0x7f3a3c137600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 shutdown_connections 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 >> 10.20.193.21:0/1427274138 conn(0x7f3a3c0b78c0 msgr2=0x7f3a3c162470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 shutdown_connections 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 -- 10.20.193.21:0/1427274138 wait complete. 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7f3a444e8640 1 librados: shutdown 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1060813911 0 0) 0x7fe84c0ad7f0 con 0x7fe84c1566e0 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe84c0ada60 con 0x7fe84c1566e0 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe840002f00 con 0x7fe84c1566e0 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.605+0000 7fe82b7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.611 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3117863059 0 0) 0x7fe21c1febd0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe21c0b33e0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe20c002ed0 con 0x7fe21c0b9f80 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7fe218ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.613 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 78341553 0 0) 0x7f8744003610 con 0x7f8774157780 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f877415bdb0 con 0x7f8774157780 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8764002fd0 con 0x7f8774157780 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 10 monclient(hunting): dump: 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.614 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.615 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.615 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.606+0000 7f875affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:19.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.9 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9100003630 con 0x7f9118157b50 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9100003980 con 0x7f9118157b50 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910d7fa640 10 monclient: dump: 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.616 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.614+0000 7f910effd640 4 set_mon_vals no callback set 2026-02-25T15:01:19.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.615+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f910001ce60 con 0x7f9118157b50 2026-02-25T15:01:19.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.616+0000 7f911cd38640 10 monclient: get_auth_request con 0x7f90e8079e90 auth_method 0 2026-02-25T15:01:19.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.616+0000 7f910d7fa640 10 client.4519.objecter ms_handle_connect 0x7f90e8079e90 2026-02-25T15:01:19.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.620+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f91000949d0 con 0x7f9118157b50 2026-02-25T15:01:19.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.620+0000 7f910d7fa640 10 client.4519.objecter ms_dispatch2 0x7f9118000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.620+0000 7f910d7fa640 3 client.4519.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.620+0000 7f910d7fa640 3 client.4519.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.620+0000 7f910d7fa640 20 client.4519.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.624 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.623+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f91180b2c90 con 0x7f9118157b50 2026-02-25T15:01:19.624 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.623+0000 7f910d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.624 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.623+0000 7f910d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.659+0000 7f875affd640 10 client.?.objecter ms_handle_connect 0x7f8774164d00 2026-02-25T15:01:19.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.659+0000 7f875affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1605171550 0 0) 0x7fe818003610 con 0x7fe84c156ab0 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe84c0ad7f0 con 0x7fe84c156ab0 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe834002d00 con 0x7fe84c156ab0 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe82b7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3174936137 0 0) 0x7fe1ec003610 con 0x7fe21c0585e0 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe21c1febd0 con 0x7fe21c0585e0 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe208002f80 con 0x7fe21c0585e0 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.661+0000 7fe218ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.664 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.664+0000 7fe4da344640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:19.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.664+0000 7fe4da344640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:19.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.664+0000 7fe4da344640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.664+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe4d405fb10 con 0x7fe4d4155f90 2026-02-25T15:01:19.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12480048d0 con 0x7f1258159a70 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1248004ce0 con 0x7f1258159a70 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1233fff640 10 monclient: dump: 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.668 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.669 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.666+0000 7f1255ffb640 4 set_mon_vals no callback set 2026-02-25T15:01:19.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.667+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f1248004ec0 con 0x7f1258159a70 2026-02-25T15:01:19.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.667+0000 7f12577fe640 10 monclient: get_auth_request con 0x7f1228079e60 auth_method 0 2026-02-25T15:01:19.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.667+0000 7f1233fff640 10 client.4509.objecter ms_handle_connect 0x7f1228079e60 2026-02-25T15:01:19.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f1248095c90 con 0x7f1258159a70 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 10 client.4509.objecter ms_dispatch2 0x7f1258000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 3 client.4509.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 3 client.4509.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 20 client.4509.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f124805f5f0 con 0x7f1258159a70 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.672 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.670+0000 7f1233fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.673+0000 7fe4d0ff9640 1 -- 10.20.193.21:0/3451815246 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 737253363) 0x7fe4c805f320 con 0x7fe4d4155f90 2026-02-25T15:01:19.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.673+0000 7fe4d0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:19.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.673+0000 7fe4d0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.675 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:19.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 10 librados: watch_flush enter 2026-02-25T15:01:19.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 10 librados: watch_flush exit 2026-02-25T15:01:19.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 20 client.4515.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 10 client.4515.objecter successfully canceled tick 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe4a4079ea0 legacy=0x7fe4a409a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 10 monclient: shutdown 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 >> v1:10.20.193.21:6789/0 conn(0x7fe4d4155f90 legacy=0x7fe4d41fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 shutdown_connections 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 >> 10.20.193.21:0/3451815246 conn(0x7fe4d40b7120 msgr2=0x7fe4d40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 shutdown_connections 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 -- 10.20.193.21:0/3451815246 wait complete. 2026-02-25T15:01:19.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.676+0000 7fe4da344640 1 librados: shutdown 2026-02-25T15:01:19.687 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.10 2026-02-25T15:01:19.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.694+0000 7f05c3513640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:19.696 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.694+0000 7f05c3513640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:19.696 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.694+0000 7f05c3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.696 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.694+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f05bc0b8ef0 con 0x7f05bc0ba350 2026-02-25T15:01:19.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 93372280 0 0) 0x7fe84c0ada60 con 0x7fe84c1566e0 2026-02-25T15:01:19.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 >> v1:10.20.193.31:6789/0 conn(0x7fe84c160c00 legacy=0x7fe84c0a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 >> v1:10.20.193.21:6789/0 conn(0x7fe84c156ab0 legacy=0x7fe84c12d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 1 monclient: found mon.c 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c0add40 con 0x7fe84c1566e0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe82b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 5 monclient: authenticate success, global_id 4526 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 monclient: _renew_subs 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c0ae020 con 0x7fe84c1566e0 2026-02-25T15:01:19.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 client.4526.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 monclient: _renew_subs 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe84c0ae5e0 con 0x7fe84c1566e0 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 1 librados: init done 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.699+0000 7fe8511a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7fe8511a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7fe8511a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84c0531e0 con 0x7fe84c1566e0 2026-02-25T15:01:19.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2050709432 0 0) 0x7f877415bdb0 con 0x7f8774157780 2026-02-25T15:01:19.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 >> v1:10.20.193.31:6789/0 conn(0x7f8774157b50 legacy=0x7f877415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 >> v1:10.20.193.21:6789/0 conn(0x7f8774164d00 legacy=0x7f87740a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 1 monclient: found mon.c 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877415c090 con 0x7f8774157780 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f875affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 5 monclient: authenticate success, global_id 4532 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 10 monclient: _renew_subs 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f877415c370 con 0x7f8774157780 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 10 client.4532.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 10 monclient: _renew_subs 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f87740a29e0 con 0x7f8774157780 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.700+0000 7f877c616640 1 librados: init done 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.701+0000 7f877c616640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.701+0000 7f877c616640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.701+0000 7f877c616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:19.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.701+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f877415ea20 con 0x7f8774157780 2026-02-25T15:01:19.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.729+0000 7f911efc3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:19.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.729+0000 7f911efc3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:19.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.729+0000 7f911efc3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.729+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f911813dba0 con 0x7f9118157b50 2026-02-25T15:01:19.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.778+0000 7f125dbc8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:19.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.778+0000 7f125dbc8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:19.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.778+0000 7f125dbc8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:19.780 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.778+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f12580b5e40 con 0x7f1258159a70 2026-02-25T15:01:19.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.781+0000 7f1233fff640 1 -- 10.20.193.21:0/89766823 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 737253363) 0x7f124805eef0 con 0x7f1258159a70 2026-02-25T15:01:19.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.781+0000 7f1233fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:19.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.781+0000 7f1233fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.783 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 10 librados: watch_flush enter 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 10 librados: watch_flush exit 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 20 client.4509.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 10 client.4509.objecter successfully canceled tick 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 >> v1:10.20.193.72:6800/2463505645 conn(0x7f1228079e60 legacy=0x7f122809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 10 monclient: shutdown 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 >> v1:10.20.193.21:6789/0 conn(0x7f1258159a70 legacy=0x7f1258161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 shutdown_connections 2026-02-25T15:01:19.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 >> 10.20.193.21:0/89766823 conn(0x7f12580b7780 msgr2=0x7f12581566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 shutdown_connections 2026-02-25T15:01:19.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 -- 10.20.193.21:0/89766823 wait complete. 2026-02-25T15:01:19.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.783+0000 7f125dbc8640 1 librados: shutdown 2026-02-25T15:01:19.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0618002bf0 con 0x7f062c0585e0 2026-02-25T15:01:19.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0618004c40 con 0x7f062c0585e0 2026-02-25T15:01:19.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f0628ff9640 10 monclient: dump: 2026-02-25T15:01:19.793 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.791+0000 7f062a7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.6 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.792+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f061801e120 con 0x7f062c0585e0 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.792+0000 7f062b7fe640 10 monclient: get_auth_request con 0x7f05fc079f80 auth_method 0 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.792+0000 7f0628ff9640 10 client.4520.objecter ms_handle_connect 0x7f05fc079f80 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.792+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f061805add0 con 0x7f062c0585e0 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.793+0000 7f0628ff9640 10 client.4520.objecter ms_dispatch2 0x7f062c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.793+0000 7f0628ff9640 3 client.4520.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.793+0000 7f0628ff9640 3 client.4520.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.793+0000 7f0628ff9640 20 client.4520.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.804 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69dc002fe0 con 0x7f69f40b9f80 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f69dc003ae0 con 0x7f69f40b9f80 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69e97fa640 10 monclient: dump: 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.805 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.806 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.806 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.806 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.803+0000 7f69eaffd640 4 set_mon_vals no callback set 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.804+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f69dc003cc0 con 0x7f69f40b9f80 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.804+0000 7f69f8856640 10 monclient: get_auth_request con 0x7f69c4079fd0 auth_method 0 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.804+0000 7f69e97fa640 10 client.4513.objecter ms_handle_connect 0x7f69c4079fd0 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.805+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f69dc095b50 con 0x7f69f40b9f80 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.805+0000 7f69e97fa640 10 client.4513.objecter ms_dispatch2 0x7f69f4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.805+0000 7f69e97fa640 3 client.4513.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.805+0000 7f69e97fa640 3 client.4513.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.805+0000 7f69e97fa640 20 client.4513.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.807+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f69f40b7fa0 con 0x7f69f40b9f80 2026-02-25T15:01:19.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.807+0000 7f69e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.807+0000 7f69e97fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.819+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45c4003630 con 0x7f45d40585e0 2026-02-25T15:01:19.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.819+0000 7f45c27fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.819+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f45c4003980 con 0x7f45d40585e0 2026-02-25T15:01:19.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.819+0000 7f45c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.820+0000 7f45c27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.820+0000 7f45c27fc640 10 monclient: dump: 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.822 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.819+0000 7f45c3fff640 4 set_mon_vals no callback set 2026-02-25T15:01:19.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.820+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f45c401ce60 con 0x7f45d40585e0 2026-02-25T15:01:19.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7f45d90b9640 10 monclient: get_auth_request con 0x7f45a4079f20 auth_method 0 2026-02-25T15:01:19.823 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7f45c27fc640 10 client.4528.objecter ms_handle_connect 0x7f45a4079f20 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1080281458 0 0) 0x7fe21c0b3100 con 0x7fe21c0ba350 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 >> v1:10.20.193.68:6789/0 conn(0x7fe21c0b9f80 legacy=0x7fe21c1fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 >> v1:10.20.193.21:6789/0 conn(0x7fe21c0585e0 legacy=0x7fe21c0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 1 monclient: found mon.b 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c0b36c0 con 0x7fe21c0ba350 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:19.825 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe218ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 5 monclient: authenticate success, global_id 4531 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 10 monclient: _renew_subs 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c161270 con 0x7fe21c0ba350 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 10 client.4531.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 10 monclient: _renew_subs 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe21c162180 con 0x7fe21c0ba350 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.821+0000 7fe22265b640 1 librados: init done 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.822+0000 7fe22265b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.822+0000 7fe22265b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.822+0000 7fe22265b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.822+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c0b91d0 con 0x7fe21c0ba350 2026-02-25T15:01:19.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.825+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f45c4094ae0 con 0x7f45d40585e0 2026-02-25T15:01:19.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.825+0000 7f45c27fc640 10 client.4528.objecter ms_dispatch2 0x7f45d4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.825+0000 7f45c27fc640 3 client.4528.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.825+0000 7f45c27fc640 3 client.4528.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.825+0000 7f45c27fc640 20 client.4528.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.827+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f45c405e440 con 0x7f45d40585e0 2026-02-25T15:01:19.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.827+0000 7f45c27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.827+0000 7f45c27fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7fe8597fa640 1 -- 10.20.193.21:0/485170255 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 778662779) 0x7fe86005f0e0 con 0x7fe8640ba350 2026-02-25T15:01:19.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7fe8597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:19.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7fe8597fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.831 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:19.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7f910d7fa640 1 -- 10.20.193.21:0/1140116277 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 737253363) 0x7f910005e330 con 0x7f9118157b50 2026-02-25T15:01:19.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7f910d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:19.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.829+0000 7f910d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.832 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.831+0000 7fe86abb3640 10 librados: watch_flush enter 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.831+0000 7fe86abb3640 10 librados: watch_flush exit 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 20 client.4501.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 10 client.4501.objecter successfully canceled tick 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe834079f80 legacy=0x7fe83409a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 10 monclient: shutdown 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 >> v1:10.20.193.31:6789/0 conn(0x7fe8640ba350 legacy=0x7fe864156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 shutdown_connections 2026-02-25T15:01:19.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 >> 10.20.193.21:0/485170255 conn(0x7fe8640b7990 msgr2=0x7fe8640b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 shutdown_connections 2026-02-25T15:01:19.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 -- 10.20.193.21:0/485170255 wait complete. 2026-02-25T15:01:19.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7fe86abb3640 1 librados: shutdown 2026-02-25T15:01:19.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 10 librados: watch_flush enter 2026-02-25T15:01:19.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 10 librados: watch_flush exit 2026-02-25T15:01:19.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 20 client.4519.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 10 client.4519.objecter successfully canceled tick 2026-02-25T15:01:19.836 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 >> v1:10.20.193.72:6800/2463505645 conn(0x7f90e8079e90 legacy=0x7f90e809a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 10 monclient: shutdown 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 >> v1:10.20.193.31:6789/0 conn(0x7f9118157b50 legacy=0x7f9118057780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 shutdown_connections 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 >> 10.20.193.21:0/1140116277 conn(0x7f91180b2ef0 msgr2=0x7f91180b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 shutdown_connections 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 -- 10.20.193.21:0/1140116277 wait complete. 2026-02-25T15:01:19.837 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.832+0000 7f911efc3640 1 librados: shutdown 2026-02-25T15:01:19.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-25T15:01:19.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.3 2026-02-25T15:01:19.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.915+0000 7f69faae1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:19.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.915+0000 7f69faae1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:19.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.915+0000 7f69faae1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.915+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f69f404b700 con 0x7f69f40b9f80 2026-02-25T15:01:19.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2100038c0 con 0x7fe21c0ba350 2026-02-25T15:01:19.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe210003c10 con 0x7fe21c0ba350 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 10 monclient: dump: 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.926 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.927 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.927 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe21a7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:19.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.924+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe21001d0f0 con 0x7fe21c0ba350 2026-02-25T15:01:19.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.925+0000 7fe21bfff640 10 monclient: get_auth_request con 0x7fe1ec07a1f0 auth_method 0 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.925+0000 7fe218ff9640 10 client.4531.objecter ms_handle_connect 0x7fe1ec07a1f0 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.926+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe210094b20 con 0x7fe21c0ba350 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.926+0000 7fe218ff9640 10 client.4531.objecter ms_dispatch2 0x7fe21c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.926+0000 7fe218ff9640 3 client.4531.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.926+0000 7fe218ff9640 3 client.4531.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.926+0000 7fe218ff9640 20 client.4531.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.928+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe21005e480 con 0x7fe21c0ba350 2026-02-25T15:01:19.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.928+0000 7fe218ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.928+0000 7fe218ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.930+0000 7f69e97fa640 1 -- 10.20.193.21:0/1873453879 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 737253363) 0x7f69dc05f4b0 con 0x7f69f40b9f80 2026-02-25T15:01:19.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.930+0000 7f69e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:19.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.930+0000 7f69e97fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.932 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:19.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 10 librados: watch_flush enter 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 10 librados: watch_flush exit 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 20 client.4513.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 10 client.4513.objecter successfully canceled tick 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 >> v1:10.20.193.72:6800/2463505645 conn(0x7f69c4079fd0 legacy=0x7f69c409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 10 monclient: shutdown 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.932+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 >> v1:10.20.193.31:6789/0 conn(0x7f69f40b9f80 legacy=0x7f69f41fdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.933+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 shutdown_connections 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.933+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 >> 10.20.193.21:0/1873453879 conn(0x7f69f40b7990 msgr2=0x7f69f415bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.933+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 shutdown_connections 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.933+0000 7f69faae1640 1 -- 10.20.193.21:0/1873453879 wait complete. 2026-02-25T15:01:19.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.933+0000 7f69faae1640 1 librados: shutdown 2026-02-25T15:01:19.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.935+0000 7f45dbb45640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:19.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.935+0000 7f45dbb45640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:19.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.935+0000 7f45dbb45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:19.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.935+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f45d40b91d0 con 0x7f45d40585e0 2026-02-25T15:01:19.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.937+0000 7f45c27fc640 1 -- 10.20.193.21:0/3137115742 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 521551722) 0x7f45c405dd40 con 0x7f45d40585e0 2026-02-25T15:01:19.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.937+0000 7f45c27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:19.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.937+0000 7f45c27fc640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.939 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 10 librados: watch_flush enter 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 10 librados: watch_flush exit 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 20 client.4528.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 10 client.4528.objecter successfully canceled tick 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 >> v1:10.20.193.72:6800/2463505645 conn(0x7f45a4079f20 legacy=0x7f45a409a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 10 monclient: shutdown 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.939+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 >> v1:10.20.193.31:6789/0 conn(0x7f45d40585e0 legacy=0x7f45d40b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.940+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 shutdown_connections 2026-02-25T15:01:19.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.940+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 >> 10.20.193.21:0/3137115742 conn(0x7f45d40b7990 msgr2=0x7f45d4158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.940+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 shutdown_connections 2026-02-25T15:01:19.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.940+0000 7f45dbb45640 1 -- 10.20.193.21:0/3137115742 wait complete. 2026-02-25T15:01:19.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.940+0000 7f45dbb45640 1 librados: shutdown 2026-02-25T15:01:19.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.13 2026-02-25T15:01:19.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.2 2026-02-25T15:01:19.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.969+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f062c159080 con 0x7f062c0585e0 2026-02-25T15:01:19.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.970+0000 7f0628ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.970+0000 7f0628ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.972+0000 7f05a9ffb640 1 -- 10.20.193.21:0/1707863770 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1257367751) 0x7f05b805df40 con 0x7f05bc0ba350 2026-02-25T15:01:19.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.972+0000 7f05a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:19.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.972+0000 7f05a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:19.974 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 10 librados: watch_flush enter 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 10 librados: watch_flush exit 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 20 client.4511.objecter shutdown clearing up homeless session... 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 10 client.4511.objecter successfully canceled tick 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 >> v1:10.20.193.72:6800/2463505645 conn(0x7f058c079fb0 legacy=0x7f058c09a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 10 monclient: shutdown 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 >> v1:10.20.193.68:6789/0 conn(0x7f05bc0ba350 legacy=0x7f05bc161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 shutdown_connections 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 >> 10.20.193.21:0/1707863770 conn(0x7f05bc0b7990 msgr2=0x7f05bc158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:19.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 shutdown_connections 2026-02-25T15:01:19.978 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 -- 10.20.193.21:0/1707863770 wait complete. 2026-02-25T15:01:19.978 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.974+0000 7f05c3513640 1 librados: shutdown 2026-02-25T15:01:19.978 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87640049f0 con 0x7f8774157780 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8764004ba0 con 0x7f8774157780 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f875affd640 10 monclient: dump: 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.979 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.975+0000 7f8778b88640 4 set_mon_vals no callback set 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.976+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f876401e080 con 0x7f8774157780 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f8779b8a640 10 monclient: get_auth_request con 0x7f8744079e90 auth_method 0 2026-02-25T15:01:19.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f875affd640 10 client.4532.objecter ms_handle_connect 0x7f8744079e90 2026-02-25T15:01:19.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f8764095ce0 con 0x7f8774157780 2026-02-25T15:01:19.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f875affd640 10 client.4532.objecter ms_dispatch2 0x7f8774000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f875affd640 3 client.4532.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.977+0000 7f875affd640 3 client.4532.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.978+0000 7f875affd640 20 client.4532.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81000034e0 con 0x7f81040ba350 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8100004fc0 con 0x7f81040ba350 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 10 monclient: dump: 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.983 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.984 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f37fe640 4 set_mon_vals no callback set 2026-02-25T15:01:19.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.982+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f810001e4a0 con 0x7f81040ba350 2026-02-25T15:01:19.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.8 2026-02-25T15:01:19.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.983+0000 7f8109710640 10 monclient: get_auth_request con 0x7f80d4079fb0 auth_method 0 2026-02-25T15:01:19.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.983+0000 7f80f1ffb640 10 client.4523.objecter ms_handle_connect 0x7f80d4079fb0 2026-02-25T15:01:19.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8400034d0 con 0x7fe84c1566e0 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe840003820 con 0x7fe84c1566e0 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe82b7fe640 10 monclient: dump: 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:19.988 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:19.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.985+0000 7fe849573640 4 set_mon_vals no callback set 2026-02-25T15:01:19.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.986+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe84001cd00 con 0x7fe84c1566e0 2026-02-25T15:01:19.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.987+0000 7fe84a575640 10 monclient: get_auth_request con 0x7fe81807a130 auth_method 0 2026-02-25T15:01:19.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.987+0000 7fe82b7fe640 10 client.4526.objecter ms_handle_connect 0x7fe81807a130 2026-02-25T15:01:19.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.988+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f8100095f40 con 0x7f81040ba350 2026-02-25T15:01:19.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.988+0000 7f80f1ffb640 10 client.4523.objecter ms_dispatch2 0x7f8104000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.988+0000 7f80f1ffb640 3 client.4523.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.988+0000 7f80f1ffb640 3 client.4523.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.988+0000 7f80f1ffb640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.991+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe840094730 con 0x7fe84c1566e0 2026-02-25T15:01:19.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.991+0000 7fe82b7fe640 10 client.4526.objecter ms_dispatch2 0x7fe84c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:19.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.991+0000 7fe82b7fe640 3 client.4526.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:19.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.991+0000 7fe82b7fe640 3 client.4526.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:19.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.991+0000 7fe82b7fe640 20 client.4526.objecter dump_active .. 0 homeless 2026-02-25T15:01:19.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.993+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f876405f640 con 0x7f8774157780 2026-02-25T15:01:19.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.993+0000 7f875affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.993+0000 7f875affd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f8104163930 con 0x7f81040ba350 2026-02-25T15:01:19.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7f80f1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7f80f1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:19.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe84c0531e0 con 0x7fe84c1566e0 2026-02-25T15:01:19.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7fe82b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:19.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:19.995+0000 7fe82b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.037+0000 7fe22265b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:20.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.037+0000 7fe22265b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:20.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.037+0000 7fe22265b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.037+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fe21c0b8ef0 con 0x7fe21c0ba350 2026-02-25T15:01:20.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.041+0000 7fe218ff9640 1 -- 10.20.193.21:0/173912398 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 521551722) 0x7fe21005dd80 con 0x7fe21c0ba350 2026-02-25T15:01:20.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.041+0000 7fe218ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:20.042 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.041+0000 7fe218ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.043 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:20.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 10 librados: watch_flush enter 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 10 librados: watch_flush exit 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 20 client.4531.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 10 client.4531.objecter successfully canceled tick 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe1ec07a1f0 legacy=0x7fe1ec09a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 10 monclient: shutdown 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 >> v1:10.20.193.31:6789/0 conn(0x7fe21c0ba350 legacy=0x7fe21c161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 shutdown_connections 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 >> 10.20.193.21:0/173912398 conn(0x7fe21c0b7990 msgr2=0x7fe21c158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 shutdown_connections 2026-02-25T15:01:20.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 -- 10.20.193.21:0/173912398 wait complete. 2026-02-25T15:01:20.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.043+0000 7fe22265b640 1 librados: shutdown 2026-02-25T15:01:20.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.15 2026-02-25T15:01:20.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.079+0000 7f06326c6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:20.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.079+0000 7f06326c6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:20.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.079+0000 7f06326c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.079+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f062c1f97a0 con 0x7f062c0585e0 2026-02-25T15:01:20.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.082+0000 7f0628ff9640 1 -- 10.20.193.21:0/3809599525 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 737253363) 0x7f062c163930 con 0x7f062c0585e0 2026-02-25T15:01:20.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.082+0000 7f0628ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:20.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.082+0000 7f0628ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.084 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:20.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 10 librados: watch_flush enter 2026-02-25T15:01:20.086 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 10 librados: watch_flush exit 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 20 client.4520.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 10 client.4520.objecter successfully canceled tick 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 >> v1:10.20.193.72:6800/2463505645 conn(0x7f05fc079f80 legacy=0x7f05fc09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 10 monclient: shutdown 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 >> v1:10.20.193.68:6789/0 conn(0x7f062c0585e0 legacy=0x7f062c1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 shutdown_connections 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 >> 10.20.193.21:0/3809599525 conn(0x7f062c0b7990 msgr2=0x7f062c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 shutdown_connections 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 -- 10.20.193.21:0/3809599525 wait complete. 2026-02-25T15:01:20.087 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.084+0000 7f06326c6640 1 librados: shutdown 2026-02-25T15:01:20.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.14 2026-02-25T15:01:20.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.105+0000 7f810b99b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:20.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.105+0000 7f810b99b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:20.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.105+0000 7f810b99b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.105+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f81040b8ef0 con 0x7f81040ba350 2026-02-25T15:01:20.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7fe8511a2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:20.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7fe8511a2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:20.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7fe8511a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe84c15d8f0 con 0x7fe84c1566e0 2026-02-25T15:01:20.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7f877c616640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:20.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7f877c616640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:20.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7f877c616640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.107+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f8774057480 con 0x7f8774157780 2026-02-25T15:01:20.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.108+0000 7f80f1ffb640 1 -- 10.20.193.21:0/1616331578 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 737253363) 0x7f810005f8a0 con 0x7f81040ba350 2026-02-25T15:01:20.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.108+0000 7f80f1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:20.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.108+0000 7f80f1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.111 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 10 librados: watch_flush enter 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 10 librados: watch_flush exit 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 10 client.4523.objecter successfully canceled tick 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 >> v1:10.20.193.72:6800/2463505645 conn(0x7f80d4079fb0 legacy=0x7f80d409a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 10 monclient: shutdown 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 >> v1:10.20.193.68:6789/0 conn(0x7f81040ba350 legacy=0x7f8104161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.113 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 shutdown_connections 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 >> 10.20.193.21:0/1616331578 conn(0x7f81040b7990 msgr2=0x7f8104158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 shutdown_connections 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 -- 10.20.193.21:0/1616331578 wait complete. 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.110+0000 7f810b99b640 1 librados: shutdown 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7fe82b7fe640 1 -- 10.20.193.21:0/1937177984 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 737253363) 0x7fe84005e090 con 0x7fe84c1566e0 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7fe82b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:20.114 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7fe82b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7f875affd640 1 -- 10.20.193.21:0/2710320832 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 521551722) 0x7f876405ef40 con 0x7f8774157780 2026-02-25T15:01:20.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7f875affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:20.115 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.112+0000 7f875affd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.115 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:20.116 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:20.116 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 10 librados: watch_flush enter 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 10 librados: watch_flush exit 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 20 client.4526.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 10 client.4526.objecter successfully canceled tick 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 10 librados: watch_flush enter 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 10 librados: watch_flush exit 2026-02-25T15:01:20.117 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 20 client.4532.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 10 client.4532.objecter successfully canceled tick 2026-02-25T15:01:20.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe81807a130 legacy=0x7fe81809a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 10 monclient: shutdown 2026-02-25T15:01:20.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 >> v1:10.20.193.68:6789/0 conn(0x7fe84c1566e0 legacy=0x7fe84c13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 >> v1:10.20.193.72:6800/2463505645 conn(0x7f8744079e90 legacy=0x7f874409a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 10 monclient: shutdown 2026-02-25T15:01:20.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 >> v1:10.20.193.68:6789/0 conn(0x7f8774157780 legacy=0x7f877412e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 shutdown_connections 2026-02-25T15:01:20.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 >> 10.20.193.21:0/1937177984 conn(0x7fe84c0b2ef0 msgr2=0x7fe84c05b660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 shutdown_connections 2026-02-25T15:01:20.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 shutdown_connections 2026-02-25T15:01:20.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 >> 10.20.193.21:0/2710320832 conn(0x7f87740b2ef0 msgr2=0x7f8774156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 -- 10.20.193.21:0/1937177984 wait complete. 2026-02-25T15:01:20.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 shutdown_connections 2026-02-25T15:01:20.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 -- 10.20.193.21:0/2710320832 wait complete. 2026-02-25T15:01:20.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7fe8511a2640 1 librados: shutdown 2026-02-25T15:01:20.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.115+0000 7f877c616640 1 librados: shutdown 2026-02-25T15:01:20.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.12 2026-02-25T15:01:20.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.11 2026-02-25T15:01:20.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.5 2026-02-25T15:01:20.515 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T15:01:20.578 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-25T15:01:20.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.580+0000 7fa5c954c640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.580+0000 7fa5c954c640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.581+0000 7fa5c954c640 10 monclient: monmap: 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.581711+0000 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.581711+0000 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.583 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.581+0000 7fa5c954c640 1 Processor -- start 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.581+0000 7fa5c954c640 1 -- start start 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.581+0000 7fa5c954c640 10 monclient: init 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-b con 0x7fa5c41566e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-a con 0x7fa5c4160c00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-c con 0x7fa5c4156ab0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c4058480 con 0x7fa5c4160c00 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c4058760 con 0x7fa5c41566e0 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c40b0f90 con 0x7fa5c4156ab0 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c954c640 10 monclient(hunting): authenticate will time out at 3024.174097s 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c2ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fa5c41566e0 0x7fa5c40b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47304/0 (socket says 10.20.193.21:47304) 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c27fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fa5c4160c00 0x7fa5c4057920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46638/0 (socket says 10.20.193.21:46638) 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.582+0000 7fa5c2ffd640 1 -- 10.20.193.21:0/4233278967 learned_addr learned my addr 10.20.193.21:0/4233278967 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451994943 0 0) 0x7fa5c4058760 con 0x7fa5c41566e0 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): my global_id is 4537 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5b0003610 con 0x7fa5c41566e0 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569395930 0 0) 0x7fa5c40b0f90 con 0x7fa5c4156ab0 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): my global_id is 4535 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c4058760 con 0x7fa5c4156ab0 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789638277 0 0) 0x7fa5c4058480 con 0x7fa5c4160c00 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 10 monclient(hunting): my global_id is 4536 2026-02-25T15:01:20.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.584+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c40b0f90 con 0x7fa5c4160c00 2026-02-25T15:01:20.589 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T15:01:20.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218269912 0 0) 0x7fa5c40b0f90 con 0x7fa5c4160c00 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 >> v1:10.20.193.68:6789/0 conn(0x7fa5c4156ab0 legacy=0x7fa5c4055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 >> v1:10.20.193.31:6789/0 conn(0x7fa5c41566e0 legacy=0x7fa5c40b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 monclient: found mon.noname-a 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c40b1270 con 0x7fa5c4160c00 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5ac002dd0 con 0x7fa5c4160c00 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c1ffb640 10 monclient: dump: 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.595 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c954c640 5 monclient: authenticate success, global_id 4536 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.585+0000 7fa5c954c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5ac002fa0 con 0x7fa5c4160c00 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 1 -- 10.20.193.21:0/4233278967 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5ac0033e0 con 0x7fa5c4160c00 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c1ffb640 10 monclient: dump: 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.596 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c954c640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.586+0000 7fa5c954c640 4 set_mon_vals no callback set 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 10 monclient: shutdown 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- 10.20.193.21:0/4233278967 >> v1:10.20.193.21:6789/0 conn(0x7fa5c4160c00 legacy=0x7fa5c4057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- 10.20.193.21:0/4233278967 shutdown_connections 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- 10.20.193.21:0/4233278967 >> 10.20.193.21:0/4233278967 conn(0x7fa5c40b2ef0 msgr2=0x7fa5c40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- 10.20.193.21:0/4233278967 shutdown_connections 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- 10.20.193.21:0/4233278967 wait complete. 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 10 monclient: monmap: 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.598 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 librados: starting msgr at 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 librados: starting objecter 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 Processor -- start 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.587+0000 7fa5c954c640 1 -- start start 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 1 librados: setting wanted keys 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 1 librados: calling monclient init 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient: init 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-c con 0x7fa5c41566e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-a con 0x7fa5c4156ab0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient(hunting): picked mon.noname-b con 0x7fa5c4160c00 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c40a76e0 con 0x7fa5c4156ab0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c40a9640 con 0x7fa5c4160c00 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c40a9920 con 0x7fa5c41566e0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c954c640 10 monclient(hunting): authenticate will time out at 3024.180402s 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c27fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fa5c4156ab0 0x7fa5c40a61b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46652/0 (socket says 10.20.193.21:46652) 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5c27fc640 1 -- 10.20.193.21:0/389754492 learned_addr learned my addr 10.20.193.21:0/389754492 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5a37fe640 10 client.?.objecter ms_handle_connect 0x7fa5c4156ab0 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.588+0000 7fa5a37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 client.?.objecter ms_handle_connect 0x7fa5c41566e0 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 client.?.objecter ms_handle_connect 0x7fa5c4160c00 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045767936 0 0) 0x7fa5c40a76e0 con 0x7fa5c4156ab0 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 10 monclient(hunting): my global_id is 4539 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.589+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa590003610 con 0x7fa5c4156ab0 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214557940 0 0) 0x7fa5c40a9920 con 0x7fa5c41566e0 2026-02-25T15:01:20.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): my global_id is 4538 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c40a76e0 con 0x7fa5c41566e0 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333235165 0 0) 0x7fa5c40a9640 con 0x7fa5c4160c00 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 10 monclient(hunting): my global_id is 4540 2026-02-25T15:01:20.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.590+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c40a9920 con 0x7fa5c4160c00 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 262178134 0 0) 0x7fa590003610 con 0x7fa5c4156ab0 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5c40a9640 con 0x7fa5c4156ab0 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5ac0032f0 con 0x7fa5c4156ab0 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.606 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3656920405 0 0) 0x7fa5c40a9920 con 0x7fa5c4160c00 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa590003610 con 0x7fa5c4160c00 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5b4003400 con 0x7fa5c4160c00 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2275104227 0 0) 0x7fa5c40a76e0 con 0x7fa5c41566e0 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5c40a9920 con 0x7fa5c41566e0 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5b80030b0 con 0x7fa5c41566e0 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.592+0000 7fa5a37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2902709074 0 0) 0x7fa5c40a9640 con 0x7fa5c4156ab0 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 >> v1:10.20.193.68:6789/0 conn(0x7fa5c41566e0 legacy=0x7fa5c40a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 >> v1:10.20.193.31:6789/0 conn(0x7fa5c4160c00 legacy=0x7fa5c409ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 1 monclient: found mon.a 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c40a7980 con 0x7fa5c4156ab0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5c954c640 5 monclient: authenticate success, global_id 4539 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5c954c640 10 monclient: _renew_subs 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5c954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.593+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c40a7c60 con 0x7fa5c4156ab0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 client.4539.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 monclient: _renew_subs 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5c412e1d0 con 0x7fa5c4156ab0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 1 librados: init done 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.594+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c415a520 con 0x7fa5c4156ab0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5ac003490 con 0x7fa5c4156ab0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5ac004b80 con 0x7fa5c4156ab0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5a37fe640 10 monclient: dump: 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.611 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.604+0000 7fa5c17fa640 4 set_mon_vals no callback set 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.605+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fa5ac01e060 con 0x7fa5c4156ab0 2026-02-25T15:01:20.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.605+0000 7fa5c2ffd640 10 monclient: get_auth_request con 0x7fa59007a0f0 auth_method 0 2026-02-25T15:01:20.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.606+0000 7fa5a37fe640 10 client.4539.objecter ms_handle_connect 0x7fa59007a0f0 2026-02-25T15:01:20.616 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-25T15:01:20.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 10 monclient: monmap: 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.646787+0000 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.646787+0000 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.648 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 1 Processor -- start 2026-02-25T15:01:20.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 1 -- start start 2026-02-25T15:01:20.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.646+0000 7f515e308640 10 monclient: init 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient(hunting): picked mon.noname-a con 0x7f515815d070 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient(hunting): picked mon.noname-b con 0x7f515815d440 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient(hunting): picked mon.noname-c con 0x7f5158166f60 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5158164e60 con 0x7f515815d070 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51580b1790 con 0x7f515815d440 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51580b1a70 con 0x7f5158166f60 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f515e308640 10 monclient(hunting): authenticate will time out at 3024.239077s 2026-02-25T15:01:20.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f51577fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f515815d440 0x7f5158166850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47320/0 (socket says 10.20.193.21:47320) 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.647+0000 7f51577fe640 1 -- 10.20.193.21:0/1480427827 learned_addr learned my addr 10.20.193.21:0/1480427827 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638042661 0 0) 0x7f51580b1790 con 0x7f515815d440 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): my global_id is 4543 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f513c003610 con 0x7f515815d440 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590884083 0 0) 0x7f51580b1a70 con 0x7f5158166f60 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 10 monclient(hunting): my global_id is 4541 2026-02-25T15:01:20.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.648+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51580b1790 con 0x7f5158166f60 2026-02-25T15:01:20.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893998851 0 0) 0x7f513c003610 con 0x7f515815d440 2026-02-25T15:01:20.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 >> v1:10.20.193.68:6789/0 conn(0x7f5158166f60 legacy=0x7f51580b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 >> v1:10.20.193.21:6789/0 conn(0x7f515815d070 legacy=0x7f5158164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 monclient: found mon.noname-b 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51580b1d50 con 0x7f515815d440 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5148002df0 con 0x7f515815d440 2026-02-25T15:01:20.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f5156ffd640 10 monclient: dump: 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.658 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f515e308640 5 monclient: authenticate success, global_id 4543 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.650+0000 7f515e308640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5148003000 con 0x7f515815d440 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 1 -- 10.20.193.21:0/1480427827 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5148003440 con 0x7f515815d440 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f5156ffd640 10 monclient: dump: 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.659 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 4 set_mon_vals no callback set 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 10 monclient: shutdown 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 -- 10.20.193.21:0/1480427827 >> v1:10.20.193.31:6789/0 conn(0x7f515815d440 legacy=0x7f5158166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 -- 10.20.193.21:0/1480427827 shutdown_connections 2026-02-25T15:01:20.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 -- 10.20.193.21:0/1480427827 >> 10.20.193.21:0/1480427827 conn(0x7f51580b2ef0 msgr2=0x7f51580b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 -- 10.20.193.21:0/1480427827 shutdown_connections 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 -- 10.20.193.21:0/1480427827 wait complete. 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 10 monclient: monmap: 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.661 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 librados: starting msgr at 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 librados: starting objecter 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.651+0000 7f515e308640 1 Processor -- start 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 -- start start 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 librados: setting wanted keys 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 librados: calling monclient init 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient: init 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:20.662 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient(hunting): picked mon.noname-c con 0x7f515815d070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient(hunting): picked mon.noname-a con 0x7f515815d440 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient(hunting): picked mon.noname-b con 0x7f5158166f60 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515811f4d0 con 0x7f515815d440 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515811f7b0 con 0x7f5158166f60 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f515811fa90 con 0x7f515815d070 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515e308640 10 monclient(hunting): authenticate will time out at 3024.244395s 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515c87e640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f5158166f60 0x7f5158156d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47336/0 (socket says 10.20.193.21:47336) 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f515c87e640 1 -- 10.20.193.21:0/3593161012 learned_addr learned my addr 10.20.193.21:0/3593161012 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f5154ff9640 10 client.?.objecter ms_handle_connect 0x7f5158166f60 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.652+0000 7f5154ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 client.?.objecter ms_handle_connect 0x7f515815d070 2026-02-25T15:01:20.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086380641 0 0) 0x7f515811f7b0 con 0x7f5158166f60 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 10 monclient(hunting): my global_id is 4546 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.653+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5128003610 con 0x7f5158166f60 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763541263 0 0) 0x7f515811fa90 con 0x7f515815d070 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 10 monclient(hunting): my global_id is 4544 2026-02-25T15:01:20.665 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.654+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f515811f7b0 con 0x7f515815d070 2026-02-25T15:01:20.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2110186661 0 0) 0x7f5128003610 con 0x7f5158166f60 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f515811fa90 con 0x7f5158166f60 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f514c0033d0 con 0x7f5158166f60 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.667 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.656+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2897933375 0 0) 0x7f515811f7b0 con 0x7f515815d070 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5128003610 con 0x7f515815d070 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5144002f70 con 0x7f515815d070 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:20.668 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 558214415 0 0) 0x7f515811fa90 con 0x7f5158166f60 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 >> v1:10.20.193.68:6789/0 conn(0x7f515815d070 legacy=0x7f515811ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 >> v1:10.20.193.21:6789/0 conn(0x7f515815d440 legacy=0x7f5158127df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.669 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 monclient: found mon.b 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515811fd70 con 0x7f5158166f60 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f5154ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 5 monclient: authenticate success, global_id 4546 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 10 monclient: _renew_subs 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5158120050 con 0x7f5158166f60 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 10 client.4546.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 10 monclient: _renew_subs 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.670 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5158157480 con 0x7f5158166f60 2026-02-25T15:01:20.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.657+0000 7f515e308640 1 librados: init done 2026-02-25T15:01:20.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.658+0000 7f515e308640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.658+0000 7f515e308640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.658+0000 7f515e308640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.671 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.658+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51580b0810 con 0x7f5158166f60 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.659+0000 7f9d9b232640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.659+0000 7f9d9b232640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.659+0000 7f9d9b232640 10 monclient: monmap: 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.660413+0000 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.660413+0000 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.674 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 1 Processor -- start 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 1 -- start start 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient: init 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-a con 0x7f9d941598e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-b con 0x7f9d940b27f0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-c con 0x7f9d9405a010 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9405d230 con 0x7f9d941598e0 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d940b1750 con 0x7f9d940b27f0 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d940b1a30 con 0x7f9d9405a010 2026-02-25T15:01:20.675 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.660+0000 7f9d9b232640 10 monclient(hunting): authenticate will time out at 3024.252898s 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.661+0000 7f9d997a8640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9d9405a010 0x7f9d941c7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54314/0 (socket says 10.20.193.21:54314) 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.661+0000 7f9d997a8640 1 -- 10.20.193.21:0/4005430466 learned_addr learned my addr 10.20.193.21:0/4005430466 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573078847 0 0) 0x7f9d940b1a30 con 0x7f9d9405a010 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 10 monclient(hunting): my global_id is 4547 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.662+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d80003610 con 0x7f9d9405a010 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1113850415 0 0) 0x7f9d80003610 con 0x7f9d9405a010 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 >> v1:10.20.193.31:6789/0 conn(0x7f9d940b27f0 legacy=0x7f9d94059900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 >> v1:10.20.193.21:6789/0 conn(0x7f9d941598e0 legacy=0x7f9d940575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.676 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 monclient: found mon.noname-c 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d940b1d10 con 0x7f9d9405a010 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9d90003170 con 0x7f9d9405a010 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d8b7fe640 10 monclient: dump: 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.677 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d9b232640 5 monclient: authenticate success, global_id 4547 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.664+0000 7f9d9b232640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d90003380 con 0x7f9d9405a010 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 1 -- 10.20.193.21:0/4005430466 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9d900037c0 con 0x7f9d9405a010 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 4 set_mon_vals no callback set 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d8b7fe640 10 monclient: dump: 2026-02-25T15:01:20.678 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 10 monclient: shutdown 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 -- 10.20.193.21:0/4005430466 >> v1:10.20.193.68:6789/0 conn(0x7f9d9405a010 legacy=0x7f9d941c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 -- 10.20.193.21:0/4005430466 shutdown_connections 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 -- 10.20.193.21:0/4005430466 >> 10.20.193.21:0/4005430466 conn(0x7f9d940b7120 msgr2=0x7f9d940b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.679 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 -- 10.20.193.21:0/4005430466 shutdown_connections 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 -- 10.20.193.21:0/4005430466 wait complete. 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f514c003a80 con 0x7f5158166f60 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f514c003e90 con 0x7f5158166f60 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f51567fc640 4 set_mon_vals no callback set 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f5154ff9640 10 monclient: dump: 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.680 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.681 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 10 monclient: monmap: 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 librados: starting msgr at 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 librados: starting objecter 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.682 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.665+0000 7f9d9b232640 1 Processor -- start 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 -- start start 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 librados: setting wanted keys 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 librados: calling monclient init 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient: init 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f514c004070 con 0x7f5158166f60 2026-02-25T15:01:20.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-b con 0x7f9d9405a010 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-a con 0x7f9d940b27f0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient(hunting): picked mon.noname-c con 0x7f9d941598e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d940b65a0 con 0x7f9d940b27f0 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d94157350 con 0x7f9d9405a010 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d94157630 con 0x7f9d941598e0 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d9b232640 10 monclient(hunting): authenticate will time out at 3024.258469s 2026-02-25T15:01:20.684 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f5157fff640 10 monclient: get_auth_request con 0x7f5128079e60 auth_method 0 2026-02-25T15:01:20.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d997a8640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9d941598e0 0x7f9d941fa920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54318/0 (socket says 10.20.193.21:54318) 2026-02-25T15:01:20.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f9d997a8640 1 -- 10.20.193.21:0/4191508240 learned_addr learned my addr 10.20.193.21:0/4191508240 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.666+0000 7f5154ff9640 10 client.4546.objecter ms_handle_connect 0x7f5128079e60 2026-02-25T15:01:20.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 client.?.objecter ms_handle_connect 0x7f9d941598e0 2026-02-25T15:01:20.685 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f514c095ff0 con 0x7f5158166f60 2026-02-25T15:01:20.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f5154ff9640 10 client.4546.objecter ms_dispatch2 0x7f5158000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f5154ff9640 3 client.4546.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f5154ff9640 3 client.4546.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.686 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f5154ff9640 20 client.4546.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.687 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869554424 0 0) 0x7f9d94157630 con 0x7f9d941598e0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 10 monclient(hunting): my global_id is 4550 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.667+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d64003610 con 0x7f9d941598e0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3274966694 0 0) 0x7f9d64003610 con 0x7f9d941598e0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d94157630 con 0x7f9d941598e0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9d900036d0 con 0x7f9d941598e0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 10 monclient(hunting): dump: 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.688 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.670+0000 7f9d897fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2136632278 0 0) 0x7f9d94157630 con 0x7f9d941598e0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 >> v1:10.20.193.31:6789/0 conn(0x7f9d9405a010 legacy=0x7f9d940b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 >> v1:10.20.193.21:6789/0 conn(0x7f9d940b27f0 legacy=0x7f9d94165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 1 monclient: found mon.c 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d94157910 con 0x7f9d941598e0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 5 monclient: authenticate success, global_id 4550 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 10 monclient: _renew_subs 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d94157bf0 con 0x7f9d941598e0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 10 client.4550.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 10 monclient: _renew_subs 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d941663e0 con 0x7f9d941598e0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.672+0000 7f9d9b232640 1 librados: init done 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.673+0000 7f9d9b232640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.673+0000 7f9d9b232640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.673+0000 7f9d9b232640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.673+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d940b1380 con 0x7f9d941598e0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d90003380 con 0x7f9d941598e0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9d90005200 con 0x7f9d941598e0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d8affd640 4 set_mon_vals no callback set 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f9d897fa640 10 monclient: dump: 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.690 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f82a07e0640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f82a07e0640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.680+0000 7f82a07e0640 10 monclient: monmap: 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.681399+0000 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.681399+0000 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.691 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.681+0000 7f82a07e0640 1 Processor -- start 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.681+0000 7f82a07e0640 1 -- start start 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.681+0000 7f82a07e0640 10 monclient: init 2026-02-25T15:01:20.692 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-25T15:01:20.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.681+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f9d9001e6e0 con 0x7f9d941598e0 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.681+0000 7f82a07e0640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-b con 0x7f829815e6e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-a con 0x7f8298055980 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-c con 0x7f8298059470 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8298165370 con 0x7f8298055980 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8298055ee0 con 0x7f829815e6e0 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8298165090 con 0x7f8298059470 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.693 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f82a07e0640 10 monclient(hunting): authenticate will time out at 3024.274095s 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d98fa7640 10 monclient: get_auth_request con 0x7f9d64079ea0 auth_method 0 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 10 client.4550.objecter ms_handle_connect 0x7f9d64079ea0 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f9d900960b0 con 0x7f9d941598e0 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 10 client.4550.objecter ms_dispatch2 0x7f9d94000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 3 client.4550.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 3 client.4550.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f9d897fa640 20 client.4550.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f829ed56640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8298059470 0x7f82981c6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54332/0 (socket says 10.20.193.21:54332) 2026-02-25T15:01:20.694 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.682+0000 7f829ed56640 1 -- 10.20.193.21:0/1606681206 learned_addr learned my addr 10.20.193.21:0/1606681206 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fa5ac0959f0 con 0x7fa5c4156ab0 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 10 client.4539.objecter ms_dispatch2 0x7fa5c4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 3 client.4539.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 3 client.4539.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 20 client.4539.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fa5ac05f350 con 0x7fa5c4156ab0 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.695 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.689+0000 7fa5a37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908528411 0 0) 0x7f8298165370 con 0x7f8298055980 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 10 monclient(hunting): my global_id is 4542 2026-02-25T15:01:20.697 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.695+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8280003610 con 0x7f8298055980 2026-02-25T15:01:20.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2654996983 0 0) 0x7f8280003610 con 0x7f8298055980 2026-02-25T15:01:20.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 >> v1:10.20.193.68:6789/0 conn(0x7f8298059470 legacy=0x7f82981c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 >> v1:10.20.193.31:6789/0 conn(0x7f829815e6e0 legacy=0x7f82980b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 monclient: found mon.noname-a 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82980b66e0 con 0x7f8298055980 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f828c002df0 con 0x7f8298055980 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:20.699 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f829d553640 10 monclient: dump: 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f82a07e0640 5 monclient: authenticate success, global_id 4542 2026-02-25T15:01:20.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.696+0000 7f82a07e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f828c003070 con 0x7f8298055980 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 1 -- 10.20.193.21:0/1606681206 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f828c0034b0 con 0x7f8298055980 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f829d553640 10 monclient: dump: 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f82a07e0640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.697+0000 7f82a07e0640 4 set_mon_vals no callback set 2026-02-25T15:01:20.702 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 10 monclient: shutdown 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 1 -- 10.20.193.21:0/1606681206 >> v1:10.20.193.21:6789/0 conn(0x7f8298055980 legacy=0x7f8298058d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 1 -- 10.20.193.21:0/1606681206 shutdown_connections 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 1 -- 10.20.193.21:0/1606681206 >> 10.20.193.21:0/1606681206 conn(0x7f82980b4120 msgr2=0x7f82980b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 1 -- 10.20.193.21:0/1606681206 shutdown_connections 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 1 -- 10.20.193.21:0/1606681206 wait complete. 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.698+0000 7f82a07e0640 10 monclient: monmap: 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 librados: starting msgr at 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 librados: starting objecter 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.703 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 Processor -- start 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 -- start start 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 librados: setting wanted keys 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 librados: calling monclient init 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient: init 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-b con 0x7f8298055980 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-a con 0x7f8298059470 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient(hunting): picked mon.noname-c con 0x7f829815e6e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82980b0a50 con 0x7f8298059470 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82980abcc0 con 0x7f8298055980 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82980abfa0 con 0x7f829815e6e0 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.699+0000 7f82a07e0640 10 monclient(hunting): authenticate will time out at 3024.291786s 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.700+0000 7f829dd54640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f8298059470 0x7f82981fc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46712/0 (socket says 10.20.193.21:46712) 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.700+0000 7f829dd54640 1 -- 10.20.193.21:0/1601722245 learned_addr learned my addr 10.20.193.21:0/1601722245 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.700+0000 7f827effd640 10 client.?.objecter ms_handle_connect 0x7f8298059470 2026-02-25T15:01:20.704 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.700+0000 7f827effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317839695 0 0) 0x7f82980b0a50 con 0x7f8298059470 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 10 monclient(hunting): my global_id is 4545 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.701+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8268003610 con 0x7f8298059470 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4270463296 0 0) 0x7f8268003610 con 0x7f8298059470 2026-02-25T15:01:20.705 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82980b0a50 con 0x7f8298059470 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f828c0033c0 con 0x7f8298059470 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 10 monclient(hunting): dump: 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.706 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.703+0000 7f827effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2032155171 0 0) 0x7f82980b0a50 con 0x7f8298059470 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 >> v1:10.20.193.68:6789/0 conn(0x7f829815e6e0 legacy=0x7f82980ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 >> v1:10.20.193.31:6789/0 conn(0x7f8298055980 legacy=0x7f82980b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 1 monclient: found mon.a 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82981633f0 con 0x7f8298059470 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.707 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f827effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 5 monclient: authenticate success, global_id 4545 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 10 monclient: _renew_subs 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82981636d0 con 0x7f8298059470 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 10 client.4545.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 10 monclient: _renew_subs 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82981fcb30 con 0x7f8298059470 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.705+0000 7f82a07e0640 1 librados: init done 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.706+0000 7f82a07e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.706+0000 7f82a07e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.706+0000 7f82a07e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.708 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.706+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82980531e0 con 0x7f8298059470 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f828c003040 con 0x7f8298059470 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f828c003a50 con 0x7f8298059470 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 10 monclient: dump: 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.714 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f829cd52640 4 set_mon_vals no callback set 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.713+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f828c003c30 con 0x7f8298059470 2026-02-25T15:01:20.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f829e555640 10 monclient: get_auth_request con 0x7f8268079fc0 auth_method 0 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 10 client.4545.objecter ms_handle_connect 0x7f8268079fc0 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f828c095c40 con 0x7f8298059470 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 10 client.4545.objecter ms_dispatch2 0x7f8298000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 3 client.4545.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 3 client.4545.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.714+0000 7f827effd640 20 client.4545.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.753+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f514c05f950 con 0x7f5158166f60 2026-02-25T15:01:20.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.754+0000 7f5154ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.754+0000 7f5154ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.765+0000 7f0fd0c6a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.765+0000 7f0fd0c6a640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.765+0000 7f0fd0c6a640 10 monclient: monmap: 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.766182+0000 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.766182+0000 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.767 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 1 Processor -- start 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 1 -- start start 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient: init 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-a con 0x7f0fcc15d0c0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-c con 0x7f0fcc0b0ca0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-b con 0x7f0fcc0b28b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc0b8540 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc0b5da0 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc0b6080 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.766+0000 7f0fd0c6a640 10 monclient(hunting): authenticate will time out at 3024.358732s 2026-02-25T15:01:20.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.767+0000 7f0fcad76640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f0fcc0b28b0 0x7f0fcc0b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47378/0 (socket says 10.20.193.21:47378) 2026-02-25T15:01:20.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.767+0000 7f0fcad76640 1 -- 10.20.193.21:0/2616266340 learned_addr learned my addr 10.20.193.21:0/2616266340 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880724726 0 0) 0x7f0fcc0b5da0 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 10 monclient(hunting): my global_id is 4549 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.768+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb8003610 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.769+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f9d940b1380 con 0x7f9d941598e0 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.769+0000 7f9d897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.769+0000 7f9d897fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4058447857 0 0) 0x7f0fb8003610 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 >> v1:10.20.193.68:6789/0 conn(0x7f0fcc0b0ca0 legacy=0x7f0fcc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 >> v1:10.20.193.21:6789/0 conn(0x7f0fcc15d0c0 legacy=0x7f0fcc0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 monclient: found mon.noname-b 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc163e10 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.774 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fbc003170 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fc9573640 10 monclient: dump: 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.775 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fd0c6a640 5 monclient: authenticate success, global_id 4549 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.770+0000 7f0fd0c6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fbc003380 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 1 -- 10.20.193.21:0/2616266340 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fbc0037c0 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fc9573640 10 monclient: dump: 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.776 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 4 set_mon_vals no callback set 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 10 monclient: shutdown 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2616266340 >> v1:10.20.193.31:6789/0 conn(0x7f0fcc0b28b0 legacy=0x7f0fcc0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2616266340 shutdown_connections 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2616266340 >> 10.20.193.21:0/2616266340 conn(0x7f0fcc0b5290 msgr2=0x7f0fcc0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2616266340 shutdown_connections 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.771+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2616266340 wait complete. 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.777 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 10 monclient: monmap: 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 librados: starting msgr at 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 librados: starting objecter 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 Processor -- start 2026-02-25T15:01:20.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 -- start start 2026-02-25T15:01:20.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 librados: setting wanted keys 2026-02-25T15:01:20.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 1 librados: calling monclient init 2026-02-25T15:01:20.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.772+0000 7f0fd0c6a640 10 monclient: init 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-b con 0x7f0fcc0b0ca0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-a con 0x7f0fcc0b28b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient(hunting): picked mon.noname-c con 0x7f0fcc15d0c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc1339b0 con 0x7f0fcc0b28b0 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc133c90 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fcc133f70 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fd0c6a640 10 monclient(hunting): authenticate will time out at 3024.365143s 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fca575640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f0fcc0b0ca0 0x7f0fcc15ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47386/0 (socket says 10.20.193.21:47386) 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fca575640 1 -- 10.20.193.21:0/2588245728 learned_addr learned my addr 10.20.193.21:0/2588245728 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fb2ffd640 10 client.?.objecter ms_handle_connect 0x7f0fcc0b0ca0 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fb2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fb2ffd640 10 client.?.objecter ms_handle_connect 0x7f0fcc15d0c0 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.773+0000 7f0fb2ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1659008150 0 0) 0x7f0fcc133c90 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): my global_id is 4552 2026-02-25T15:01:20.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f98003610 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8788258 0 0) 0x7f0fcc133f70 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 10 monclient(hunting): my global_id is 4553 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.774+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fcc133c90 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1995863068 0 0) 0x7f0f98003610 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fcc133f70 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fc0002f30 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.784 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.776+0000 7f0fb2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1289054729 0 0) 0x7f0fcc133c90 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f98003610 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fbc0036d0 con 0x7f0fcc15d0c0 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.785 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.777+0000 7f0fb2ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3112297128 0 0) 0x7f0fcc133f70 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 >> v1:10.20.193.68:6789/0 conn(0x7f0fcc15d0c0 legacy=0x7f0fcc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.786 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 >> v1:10.20.193.21:6789/0 conn(0x7f0fcc0b28b0 legacy=0x7f0fcc0b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 1 monclient: found mon.b 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc134250 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fb2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 5 monclient: authenticate success, global_id 4552 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 monclient: _renew_subs 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc134530 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 client.4552.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.787 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 monclient: _renew_subs 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0fcc15b230 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 1 librados: init done 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.778+0000 7f0fd0c6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.779+0000 7f0fd0c6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.779+0000 7f0fd0c6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.788 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.779+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc134bf0 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fc0004950 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fc0004b00 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fc8d72640 4 set_mon_vals no callback set 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.786+0000 7f0fb2ffd640 10 monclient: dump: 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0fc001dfe0 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fc9d74640 10 monclient: get_auth_request con 0x7f0f98079e60 auth_method 0 2026-02-25T15:01:20.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0fc0095c10 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 10 client.4552.objecter ms_dispatch2 0x7f0fcc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 3 client.4552.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 3 client.4552.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 20 client.4552.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.787+0000 7f0fb2ffd640 10 client.4552.objecter ms_handle_connect 0x7f0f98079e60 2026-02-25T15:01:20.796 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-25T15:01:20.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.797+0000 7fa5c954c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:20.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.797+0000 7fa5c954c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:20.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.797+0000 7fa5c954c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.797+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa5c415f170 con 0x7fa5c4156ab0 2026-02-25T15:01:20.802 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.801+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f828c05f5a0 con 0x7f8298059470 2026-02-25T15:01:20.802 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.801+0000 7f827effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.802 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.801+0000 7f827effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.804+0000 7fa5a37fe640 1 -- 10.20.193.21:0/389754492 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 778662779) 0x7fa5ac05ec50 con 0x7fa5c4156ab0 2026-02-25T15:01:20.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.804+0000 7fa5a37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:20.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.804+0000 7fa5a37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.806 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.806+0000 7fa5c954c640 10 librados: watch_flush enter 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 10 librados: watch_flush exit 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 20 client.4539.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 10 client.4539.objecter successfully canceled tick 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 >> v1:10.20.193.72:6800/2463505645 conn(0x7fa59007a0f0 legacy=0x7fa59009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 10 monclient: shutdown 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 >> v1:10.20.193.21:6789/0 conn(0x7fa5c4156ab0 legacy=0x7fa5c40a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 shutdown_connections 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 >> 10.20.193.21:0/389754492 conn(0x7fa5c40b2ef0 msgr2=0x7fa5c415f670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 shutdown_connections 2026-02-25T15:01:20.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 -- 10.20.193.21:0/389754492 wait complete. 2026-02-25T15:01:20.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.807+0000 7fa5c954c640 1 librados: shutdown 2026-02-25T15:01:20.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.1 2026-02-25T15:01:20.844 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-25T15:01:20.844 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T15:01:20.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.861+0000 7f515e308640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:20.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.861+0000 7f515e308640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:20.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.861+0000 7f515e308640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.861+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5158157700 con 0x7f5158166f60 2026-02-25T15:01:20.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.864+0000 7f5a46f3a640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.864+0000 7f5a46f3a640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.864+0000 7f5a46f3a640 10 monclient: monmap: 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.865339+0000 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.865339+0000 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 1 Processor -- start 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 1 -- start start 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient: init 2026-02-25T15:01:20.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-c con 0x7f5a40157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-b con 0x7f5a40157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-a con 0x7f5a40164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4005de70 con 0x7f5a40164d00 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a40055b20 con 0x7f5a40157b50 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a40055e00 con 0x7f5a40157780 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.865+0000 7f5a46f3a640 10 monclient(hunting): authenticate will time out at 3024.457645s 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.866+0000 7f5a454b0640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5a40164d00 0x7f5a401c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46742/0 (socket says 10.20.193.21:46742) 2026-02-25T15:01:20.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.866+0000 7f5a454b0640 1 -- 10.20.193.21:0/3437774494 learned_addr learned my addr 10.20.193.21:0/3437774494 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180476790 0 0) 0x7f5a40055e00 con 0x7f5a40157780 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): my global_id is 4556 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c003610 con 0x7f5a40157780 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322706848 0 0) 0x7f5a4005de70 con 0x7f5a40164d00 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 10 monclient(hunting): my global_id is 4548 2026-02-25T15:01:20.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.867+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a40055e00 con 0x7f5a40164d00 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3124671605 0 0) 0x7f5a2c003610 con 0x7f5a40157780 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 >> v1:10.20.193.31:6789/0 conn(0x7f5a40157b50 legacy=0x7f5a401645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 >> v1:10.20.193.21:6789/0 conn(0x7f5a40164d00 legacy=0x7f5a401c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 monclient: found mon.noname-c 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a400560e0 con 0x7f5a40157780 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a30002df0 con 0x7f5a40157780 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a377fe640 10 monclient: dump: 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a46f3a640 5 monclient: authenticate success, global_id 4556 2026-02-25T15:01:20.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.869+0000 7f5a46f3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a30003000 con 0x7f5a40157780 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 1 -- 10.20.193.21:0/3437774494 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a30003440 con 0x7f5a40157780 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a377fe640 10 monclient: dump: 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 4 set_mon_vals no callback set 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 10 monclient: shutdown 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3437774494 >> v1:10.20.193.68:6789/0 conn(0x7f5a40157780 legacy=0x7f5a40056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3437774494 shutdown_connections 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3437774494 >> 10.20.193.21:0/3437774494 conn(0x7f5a400b2ef0 msgr2=0x7f5a400b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3437774494 shutdown_connections 2026-02-25T15:01:20.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.870+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3437774494 wait complete. 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 10 monclient: monmap: 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 librados: starting msgr at 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 librados: starting objecter 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 Processor -- start 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 -- start start 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 librados: setting wanted keys 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 1 librados: calling monclient init 2026-02-25T15:01:20.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.871+0000 7f5a46f3a640 10 monclient: init 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-a con 0x7f5a40157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-c con 0x7f5a40157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient(hunting): picked mon.noname-b con 0x7f5a40164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4005d1d0 con 0x7f5a40157780 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a400af070 con 0x7f5a40164d00 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a400af350 con 0x7f5a40157b50 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a46f3a640 10 monclient(hunting): authenticate will time out at 3024.464124s 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a37fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f5a40157b50 0x7f5a4012e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54386/0 (socket says 10.20.193.21:54386) 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a37fff640 1 -- 10.20.193.21:0/3568101383 learned_addr learned my addr 10.20.193.21:0/3568101383 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a357fa640 10 client.?.objecter ms_handle_connect 0x7f5a40157b50 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a357fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a357fa640 10 client.?.objecter ms_handle_connect 0x7f5a40157780 2026-02-25T15:01:20.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.872+0000 7f5a357fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074683689 0 0) 0x7f5a400af350 con 0x7f5a40157b50 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 10 monclient(hunting): my global_id is 4559 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.873+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a10003610 con 0x7f5a40157b50 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723088210 0 0) 0x7f5a4005d1d0 con 0x7f5a40157780 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 10 monclient(hunting): my global_id is 4551 2026-02-25T15:01:20.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.874+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a400af350 con 0x7f5a40157780 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 469933296 0 0) 0x7f5a10003610 con 0x7f5a40157b50 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a4005d1d0 con 0x7f5a40157b50 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a28002fd0 con 0x7f5a40157b50 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 10 monclient(hunting): dump: 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.877 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f5a357fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.876+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f0fc005f570 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f0fb2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f0fb2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3605103656 0 0) 0x7f5a400af350 con 0x7f5a40157780 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a10003610 con 0x7f5a40157780 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a30003350 con 0x7f5a40157780 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.877+0000 7f5a357fa640 10 monclient(hunting): dump: 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.878 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1742764870 0 0) 0x7f5a4005d1d0 con 0x7f5a40157b50 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 >> v1:10.20.193.31:6789/0 conn(0x7f5a40164d00 legacy=0x7f5a40149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 >> v1:10.20.193.21:6789/0 conn(0x7f5a40157780 legacy=0x7f5a4005cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 1 monclient: found mon.c 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a400af630 con 0x7f5a40157b50 2026-02-25T15:01:20.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 5 monclient: authenticate success, global_id 4559 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _renew_subs 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a400af910 con 0x7f5a40157b50 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 client.4559.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _renew_subs 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a400afed0 con 0x7f5a40157b50 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 1 librados: init done 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.878+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a40057480 con 0x7f5a40157b50 2026-02-25T15:01:20.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f5154ff9640 1 -- 10.20.193.21:0/3593161012 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 521551722) 0x7f514c05f250 con 0x7f5158166f60 2026-02-25T15:01:20.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f5154ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:20.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f5154ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.882 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:20.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f9d9b232640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:20.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f9d9b232640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:20.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f9d9b232640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:20.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.880+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9d940b10f0 con 0x7f9d941598e0 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 10 librados: watch_flush enter 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 10 librados: watch_flush exit 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 20 client.4546.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 10 client.4546.objecter successfully canceled tick 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 >> v1:10.20.193.72:6800/2463505645 conn(0x7f5128079e60 legacy=0x7f512809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 10 monclient: shutdown 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 >> v1:10.20.193.31:6789/0 conn(0x7f5158166f60 legacy=0x7f5158156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 shutdown_connections 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 >> 10.20.193.21:0/3593161012 conn(0x7f51580b2ef0 msgr2=0x7f51580b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 shutdown_connections 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 -- 10.20.193.21:0/3593161012 wait complete. 2026-02-25T15:01:20.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.882+0000 7f515e308640 1 librados: shutdown 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a280049f0 con 0x7f5a40157b50 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a28004ba0 con 0x7f5a40157b50 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a36ffd640 4 set_mon_vals no callback set 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.887+0000 7f5a357fa640 10 monclient: dump: 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.888+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f5a2801e080 con 0x7f5a40157b50 2026-02-25T15:01:20.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.889+0000 7f5a44caf640 10 monclient: get_auth_request con 0x7f5a10079e60 auth_method 0 2026-02-25T15:01:20.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.889+0000 7f5a357fa640 10 client.4559.objecter ms_handle_connect 0x7f5a10079e60 2026-02-25T15:01:20.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.890+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f5a28095be0 con 0x7f5a40157b50 2026-02-25T15:01:20.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.890+0000 7f5a357fa640 10 client.4559.objecter ms_dispatch2 0x7f5a40000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:20.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.890+0000 7f5a357fa640 3 client.4559.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:20.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.890+0000 7f5a357fa640 3 client.4559.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:20.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.890+0000 7f5a357fa640 20 client.4559.objecter dump_active .. 0 homeless 2026-02-25T15:01:20.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.7 2026-02-25T15:01:20.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.916+0000 7f82a07e0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:20.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.916+0000 7f82a07e0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:20.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.916+0000 7f82a07e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.916+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f82980b1d50 con 0x7f8298059470 2026-02-25T15:01:20.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.919+0000 7f827effd640 1 -- 10.20.193.21:0/1601722245 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 778662779) 0x7f828c05eea0 con 0x7f8298059470 2026-02-25T15:01:20.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.919+0000 7f827effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:20.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.919+0000 7f827effd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.920 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 10 librados: watch_flush enter 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 10 librados: watch_flush exit 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 20 client.4545.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 10 client.4545.objecter successfully canceled tick 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 >> v1:10.20.193.72:6800/2463505645 conn(0x7f8268079fc0 legacy=0x7f826809a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 10 monclient: shutdown 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 >> v1:10.20.193.21:6789/0 conn(0x7f8298059470 legacy=0x7f82981fc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 shutdown_connections 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 >> 10.20.193.21:0/1601722245 conn(0x7f82980b4120 msgr2=0x7f829815cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 shutdown_connections 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 -- 10.20.193.21:0/1601722245 wait complete. 2026-02-25T15:01:20.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.922+0000 7f82a07e0640 1 librados: shutdown 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7f037527b640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7f037527b640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7f037527b640 10 monclient: monmap: 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.927664+0000 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.927664+0000 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7fe731cfa640 10 monclient: get_monmap_and_config 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7fe731cfa640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.926+0000 7fe731cfa640 10 monclient: monmap: 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.928 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:20.927675+0000 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:20.927675+0000 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 1 Processor -- start 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 1 Processor -- start 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 1 -- start start 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient: init 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 1 -- start start 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient: init 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient(hunting): picked mon.noname-b con 0x7f0370157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient(hunting): picked mon.noname-a con 0x7f0370157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-c con 0x7fe72c157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-a con 0x7fe72c157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient(hunting): picked mon.noname-c con 0x7f0370164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037005de70 con 0x7f0370157b50 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0370055b20 con 0x7f0370157780 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-b con 0x7fe72c164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c05de70 con 0x7fe72c157b50 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0370055e00 con 0x7f0370164d00 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7f037527b640 10 monclient(hunting): authenticate will time out at 3024.519952s 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c055b20 con 0x7fe72c164d00 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c055e00 con 0x7fe72c157780 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.927+0000 7fe731cfa640 10 monclient(hunting): authenticate will time out at 3024.519961s 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.928+0000 7f036e575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f0370157b50 0x7f03701645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46760/0 (socket says 10.20.193.21:46760) 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.928+0000 7f036e575640 1 -- 10.20.193.21:0/914041777 learned_addr learned my addr 10.20.193.21:0/914041777 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.928+0000 7fe72bfff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe72c164d00 0x7fe72c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47412/0 (socket says 10.20.193.21:47412) 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.928+0000 7fe72bfff640 1 -- 10.20.193.21:0/2932177818 learned_addr learned my addr 10.20.193.21:0/2932177818 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057075768 0 0) 0x7f0370055b20 con 0x7f0370157780 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): my global_id is 4555 2026-02-25T15:01:20.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f035c003610 con 0x7f0370157780 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367890369 0 0) 0x7f037005de70 con 0x7f0370157b50 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 10 monclient(hunting): my global_id is 4554 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.930+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0370055b20 con 0x7f0370157b50 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887375603 0 0) 0x7fe72c055b20 con 0x7fe72c164d00 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 10 monclient(hunting): my global_id is 4558 2026-02-25T15:01:20.932 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.931+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe710003610 con 0x7fe72c164d00 2026-02-25T15:01:20.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.9 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1740425659 0 0) 0x7f035c003610 con 0x7f0370157780 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 >> v1:10.20.193.68:6789/0 conn(0x7f0370164d00 legacy=0x7f03701c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 >> v1:10.20.193.21:6789/0 conn(0x7f0370157b50 legacy=0x7f03701645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 monclient: found mon.noname-b 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03700560e0 con 0x7f0370157780 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0364002df0 con 0x7f0370157780 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f037527b640 5 monclient: authenticate success, global_id 4555 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f037527b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f036dd74640 10 monclient: dump: 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.934 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.932+0000 7f037527b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073375815 0 0) 0x7fe72c05de70 con 0x7fe72c157b50 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 10 monclient(hunting): my global_id is 4557 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.933+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe72c055b20 con 0x7fe72c157b50 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2650875965 0 0) 0x7fe710003610 con 0x7fe72c164d00 2026-02-25T15:01:20.935 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 >> v1:10.20.193.68:6789/0 conn(0x7fe72c157780 legacy=0x7fe72c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 >> v1:10.20.193.21:6789/0 conn(0x7fe72c157b50 legacy=0x7fe72c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 monclient: found mon.noname-b 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c0560e0 con 0x7fe72c164d00 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe720003170 con 0x7fe72c164d00 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe731cfa640 5 monclient: authenticate success, global_id 4558 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe731cfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe72a7fc640 10 monclient: dump: 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.936 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.934+0000 7fe731cfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0364003000 con 0x7f0370157780 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 1 -- 10.20.193.21:0/914041777 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0364003440 con 0x7f0370157780 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f036dd74640 10 monclient: dump: 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 4 set_mon_vals no callback set 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 10 monclient: shutdown 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 1 -- 10.20.193.21:0/914041777 >> v1:10.20.193.31:6789/0 conn(0x7f0370157780 legacy=0x7f0370056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 1 -- 10.20.193.21:0/914041777 shutdown_connections 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 1 -- 10.20.193.21:0/914041777 >> 10.20.193.21:0/914041777 conn(0x7f03700b2ef0 msgr2=0x7f03700b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 1 -- 10.20.193.21:0/914041777 shutdown_connections 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.935+0000 7f037527b640 1 -- 10.20.193.21:0/914041777 wait complete. 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient: monmap: 2026-02-25T15:01:20.937 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 librados: starting msgr at 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 librados: starting objecter 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 Processor -- start 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe720003380 con 0x7fe72c164d00 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 1 -- 10.20.193.21:0/2932177818 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe7200037c0 con 0x7fe72c164d00 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe72a7fc640 10 monclient: dump: 2026-02-25T15:01:20.938 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 4 set_mon_vals no callback set 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 -- start start 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 librados: setting wanted keys 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 librados: calling monclient init 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient: init 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 10 monclient: shutdown 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 1 -- 10.20.193.21:0/2932177818 >> v1:10.20.193.31:6789/0 conn(0x7fe72c164d00 legacy=0x7fe72c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 1 -- 10.20.193.21:0/2932177818 shutdown_connections 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 1 -- 10.20.193.21:0/2932177818 >> 10.20.193.21:0/2932177818 conn(0x7fe72c0b2ef0 msgr2=0x7fe72c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 1 -- 10.20.193.21:0/2932177818 shutdown_connections 2026-02-25T15:01:20.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 1 -- 10.20.193.21:0/2932177818 wait complete. 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient(hunting): picked mon.noname-c con 0x7f0370157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient(hunting): picked mon.noname-b con 0x7f0370157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient(hunting): picked mon.noname-a con 0x7f0370164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700af0c0 con 0x7f0370164d00 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700af3a0 con 0x7f0370157b50 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03700af680 con 0x7f0370157780 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f037527b640 10 monclient(hunting): authenticate will time out at 3024.528692s 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f036f577640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f0370164d00 0x7f037012b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46784/0 (socket says 10.20.193.21:46784) 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7f036f577640 1 -- 10.20.193.21:0/3932753813 learned_addr learned my addr 10.20.193.21:0/3932753813 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 10 monclient: build_initial_monmap 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.936+0000 7fe731cfa640 10 monclient: monmap: 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:20.940 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7f034f7fe640 10 client.?.objecter ms_handle_connect 0x7f0370164d00 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7f034f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 librados: starting msgr at 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 librados: starting objecter 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 Processor -- start 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 -- start start 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 librados: setting wanted keys 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 librados: calling monclient init 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient: init 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7f034f7fe640 10 client.?.objecter ms_handle_connect 0x7f0370157b50 2026-02-25T15:01:20.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7f034f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-c con 0x7fe72c157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-b con 0x7fe72c157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient(hunting): picked mon.noname-a con 0x7fe72c164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c12cb90 con 0x7fe72c164d00 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c059530 con 0x7fe72c157b50 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c0a87f0 con 0x7fe72c157780 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.937+0000 7fe731cfa640 10 monclient(hunting): authenticate will time out at 3024.529816s 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889571719 0 0) 0x7f03700af0c0 con 0x7f0370164d00 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): my global_id is 4560 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f033c003610 con 0x7f0370164d00 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555369212 0 0) 0x7f03700af3a0 con 0x7f0370157b50 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.942 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 10 monclient(hunting): my global_id is 4561 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03700af0c0 con 0x7f0370157b50 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7fe72affd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fe72c157b50 0x7fe72c058e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47424/0 (socket says 10.20.193.21:47424) 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7fe72affd640 1 -- 10.20.193.21:0/1221788638 learned_addr learned my addr 10.20.193.21:0/1221788638 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7fe707fff640 10 client.?.objecter ms_handle_connect 0x7fe72c157b50 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.938+0000 7fe707fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7fe707fff640 10 client.?.objecter ms_handle_connect 0x7fe72c164d00 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7fe707fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 52849826 0 0) 0x7f03700af0c0 con 0x7f0370157b50 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03700af3a0 con 0x7f0370157b50 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03580030b0 con 0x7f0370157b50 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.943 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4160663651 0 0) 0x7f033c003610 con 0x7f0370164d00 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03700af0c0 con 0x7f0370164d00 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0360003230 con 0x7f0370164d00 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.941+0000 7f034f7fe640 10 monclient(hunting): dump: 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.944 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.944 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581627482 0 0) 0x7fe72c12cb90 con 0x7fe72c164d00 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 10 monclient(hunting): my global_id is 4563 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.942+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6fc003610 con 0x7fe72c164d00 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993504367 0 0) 0x7fe72c059530 con 0x7fe72c157b50 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 10 monclient(hunting): my global_id is 4564 2026-02-25T15:01:20.945 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe72c12cb90 con 0x7fe72c157b50 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4088866536 0 0) 0x7f03700af3a0 con 0x7f0370157b50 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 >> v1:10.20.193.68:6789/0 conn(0x7f0370157780 legacy=0x7f037012c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 >> v1:10.20.193.21:6789/0 conn(0x7f0370164d00 legacy=0x7f037012b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 1 monclient: found mon.b 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03700af960 con 0x7f0370157b50 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f034f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 5 monclient: authenticate success, global_id 4561 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 10 monclient: _renew_subs 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03700afc40 con 0x7f0370157b50 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 10 client.4561.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 10 monclient: _renew_subs 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03700b0620 con 0x7f0370157b50 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.943+0000 7f037527b640 1 librados: init done 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.944+0000 7f037527b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.944+0000 7f037527b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.944+0000 7f037527b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.946 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.944+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03700b0ac0 con 0x7f0370157b50 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1470038561 0 0) 0x7fe6fc003610 con 0x7fe72c164d00 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe72c059530 con 0x7fe72c164d00 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe7200036d0 con 0x7fe72c164d00 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 10 monclient(hunting): dump: 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.948 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.949 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.947+0000 7fe707fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:20.951 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1963200883 0 0) 0x7fe72c12cb90 con 0x7fe72c157b50 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6fc003610 con 0x7fe72c157b50 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe71c003170 con 0x7fe72c157b50 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient(hunting): dump: 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:20.951 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1895718484 0 0) 0x7fe72c059530 con 0x7fe72c164d00 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 >> v1:10.20.193.68:6789/0 conn(0x7fe72c157780 legacy=0x7fe72c12c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 >> v1:10.20.193.31:6789/0 conn(0x7fe72c157b50 legacy=0x7fe72c058e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 monclient: found mon.a 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c0a8ad0 con 0x7fe72c164d00 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe707fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 5 monclient: authenticate success, global_id 4563 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 10 monclient: _renew_subs 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c0a8db0 con 0x7fe72c164d00 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 10 client.4563.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:20.952 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 10 monclient: _renew_subs 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe72c0a9370 con 0x7fe72c164d00 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.950+0000 7fe731cfa640 1 librados: init done 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.951+0000 7fe731cfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.951+0000 7fe731cfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.951+0000 7fe731cfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:20.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.951+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c057480 con 0x7fe72c164d00 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.978+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f5a2805f540 con 0x7f5a40157b50 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.978+0000 7f5a357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.978+0000 7f5a357fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.979+0000 7f9d897fa640 1 -- 10.20.193.21:0/4191508240 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 778662779) 0x7f9d9005fa10 con 0x7f9d941598e0 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.979+0000 7f9d897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.979+0000 7f9d897fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:20.980 INFO:teuthology.orchestra.run.trial021.stdout:90194313219 2026-02-25T15:01:20.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 10 librados: watch_flush enter 2026-02-25T15:01:20.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 10 librados: watch_flush exit 2026-02-25T15:01:20.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 20 client.4550.objecter shutdown clearing up homeless session... 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 10 client.4550.objecter successfully canceled tick 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 >> v1:10.20.193.72:6800/2463505645 conn(0x7f9d64079ea0 legacy=0x7f9d6409a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 10 monclient: shutdown 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 >> v1:10.20.193.68:6789/0 conn(0x7f9d941598e0 legacy=0x7f9d941fa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 shutdown_connections 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 >> 10.20.193.21:0/4191508240 conn(0x7f9d940b7120 msgr2=0x7f9d94057160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 shutdown_connections 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 -- 10.20.193.21:0/4191508240 wait complete. 2026-02-25T15:01:20.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.982+0000 7f9d9b232640 1 librados: shutdown 2026-02-25T15:01:20.985 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-25T15:01:20.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.988+0000 7f0fd0c6a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:20.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.988+0000 7f0fd0c6a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:20.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.988+0000 7f0fd0c6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:20.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:20.988+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0fcc05e210 con 0x7f0fcc0b0ca0 2026-02-25T15:01:20.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.0 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 10 monclient: monmap: 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.012883+0000 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.012883+0000 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.013 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 1 Processor -- start 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 1 -- start start 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.012+0000 7f88ae313640 10 monclient: init 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-a con 0x7f88a815d070 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-c con 0x7f88a815d440 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-b con 0x7f88a8166f60 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a8164e60 con 0x7f88a815d070 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80b1790 con 0x7f88a8166f60 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80b1a70 con 0x7f88a815d440 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88ae313640 10 monclient(hunting): authenticate will time out at 3024.605171s 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88a77fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f88a815d440 0x7f88a8166850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54434/0 (socket says 10.20.193.21:54434) 2026-02-25T15:01:21.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.013+0000 7f88a77fe640 1 -- 10.20.193.21:0/3420613771 learned_addr learned my addr 10.20.193.21:0/3420613771 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.014+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552855867 0 0) 0x7f88a80b1a70 con 0x7f88a815d440 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.014+0000 7f88a6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.014+0000 7f88a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.014+0000 7f88a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.014+0000 7f88a6ffd640 10 monclient(hunting): my global_id is 4562 2026-02-25T15:01:21.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.015+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f888c003610 con 0x7f88a815d440 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.015+0000 7f76d3513640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.015+0000 7f76d3513640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.015+0000 7f76d3513640 10 monclient: monmap: 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.016530+0000 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.016530+0000 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f76d3513640 1 Processor -- start 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f76d3513640 1 -- start start 2026-02-25T15:01:21.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f76d3513640 10 monclient: init 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938291513 0 0) 0x7f888c003610 con 0x7f88a815d440 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 >> v1:10.20.193.31:6789/0 conn(0x7f88a8166f60 legacy=0x7f88a80b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 >> v1:10.20.193.21:6789/0 conn(0x7f88a815d070 legacy=0x7f88a8164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a80b1d50 con 0x7f88a815d440 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8898002df0 con 0x7f88a815d440 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88a6ffd640 10 monclient: dump: 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88ae313640 5 monclient: authenticate success, global_id 4562 2026-02-25T15:01:21.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.016+0000 7f88ae313640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-a con 0x7f76cc159a70 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-b con 0x7f76cc159e40 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-c con 0x7f76cc058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc163930 con 0x7f76cc159a70 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc163bf0 con 0x7f76cc159e40 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc163ed0 con 0x7f76cc058070 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d3513640 10 monclient(hunting): authenticate will time out at 3024.609092s 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8898003000 con 0x7f88a815d440 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 1 -- 10.20.193.21:0/3420613771 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8898003440 con 0x7f88a815d440 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88a6ffd640 10 monclient: dump: 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.019 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88ae313640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88ae313640 4 set_mon_vals no callback set 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d1a89640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f76cc058070 0x7f76cc058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54436/0 (socket says 10.20.193.21:54436) 2026-02-25T15:01:21.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f76d1a89640 1 -- 10.20.193.21:0/416667282 learned_addr learned my addr 10.20.193.21:0/416667282 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88ae313640 10 monclient: shutdown 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88ae313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.017+0000 7f88ae313640 1 -- 10.20.193.21:0/3420613771 >> v1:10.20.193.68:6789/0 conn(0x7f88a815d440 legacy=0x7f88a8166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 -- 10.20.193.21:0/3420613771 shutdown_connections 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 -- 10.20.193.21:0/3420613771 >> 10.20.193.21:0/3420613771 conn(0x7f88a80b2ef0 msgr2=0x7f88a80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 -- 10.20.193.21:0/3420613771 shutdown_connections 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 -- 10.20.193.21:0/3420613771 wait complete. 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 10 monclient: monmap: 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 librados: starting msgr at 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 librados: starting objecter 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 Processor -- start 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 -- start start 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 librados: setting wanted keys 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 1 librados: calling monclient init 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.018+0000 7f88ae313640 10 monclient: init 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-b con 0x7f88a815d070 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-a con 0x7f88a815d440 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient(hunting): picked mon.noname-c con 0x7f88a8166f60 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80af430 con 0x7f88a815d440 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80aeb90 con 0x7f88a815d070 2026-02-25T15:01:21.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80aee70 con 0x7f88a8166f60 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f88ae313640 10 monclient(hunting): authenticate will time out at 3024.611099s 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994964222 0 0) 0x7f76cc163ed0 con 0x7f76cc058070 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 10 monclient(hunting): my global_id is 4565 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.019+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b4003610 con 0x7f76cc058070 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.020+0000 7f88ac889640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f88a8166f60 0x7f88a81578d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54438/0 (socket says 10.20.193.21:54438) 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.020+0000 7f88ac889640 1 -- 10.20.193.21:0/3213451654 learned_addr learned my addr 10.20.193.21:0/3213451654 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.020+0000 7f88a4ff9640 10 client.?.objecter ms_handle_connect 0x7f88a8166f60 2026-02-25T15:01:21.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.020+0000 7f88a4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116070960 0 0) 0x7f76b4003610 con 0x7f76cc058070 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 >> v1:10.20.193.31:6789/0 conn(0x7f76cc159e40 legacy=0x7f76cc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 >> v1:10.20.193.21:6789/0 conn(0x7f76cc159a70 legacy=0x7f76cc0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 monclient: found mon.noname-c 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc057590 con 0x7f76cc058070 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f76c8003170 con 0x7f76cc058070 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76bbfff640 10 monclient: dump: 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.023 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76d3513640 5 monclient: authenticate success, global_id 4565 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.022+0000 7f76d3513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838722967 0 0) 0x7f88a80aee70 con 0x7f88a8166f60 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 10 monclient(hunting): my global_id is 4568 2026-02-25T15:01:21.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8878003610 con 0x7f88a8166f60 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76c8003380 con 0x7f76cc058070 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 1 -- 10.20.193.21:0/416667282 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f76c80037c0 con 0x7f76cc058070 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76bbfff640 10 monclient: dump: 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76d3513640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.023+0000 7f76d3513640 4 set_mon_vals no callback set 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 10 monclient: shutdown 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- 10.20.193.21:0/416667282 >> v1:10.20.193.68:6789/0 conn(0x7f76cc058070 legacy=0x7f76cc058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- 10.20.193.21:0/416667282 shutdown_connections 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- 10.20.193.21:0/416667282 >> 10.20.193.21:0/416667282 conn(0x7f76cc0b7780 msgr2=0x7f76cc0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- 10.20.193.21:0/416667282 shutdown_connections 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- 10.20.193.21:0/416667282 wait complete. 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 10 monclient: monmap: 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 librados: starting msgr at 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 librados: starting objecter 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 Processor -- start 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 -- start start 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 librados: setting wanted keys 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 1 librados: calling monclient init 2026-02-25T15:01:21.026 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.024+0000 7f76d3513640 10 monclient: init 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-c con 0x7f76cc058070 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-b con 0x7f76cc159a70 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient(hunting): picked mon.noname-a con 0x7f76cc159e40 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0b0150 con 0x7f76cc159e40 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0b0430 con 0x7f76cc159a70 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0b0710 con 0x7f76cc058070 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.025+0000 7f76d3513640 10 monclient(hunting): authenticate will time out at 3024.617304s 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2954894244 0 0) 0x7f8878003610 con 0x7f88a8166f60 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88a80aee70 con 0x7f88a8166f60 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f889c0032d0 con 0x7f88a8166f60 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.027 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.028 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.028 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f88a4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f76d1288640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f76cc058070 0x7f76cc1467b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54448/0 (socket says 10.20.193.21:54448) 2026-02-25T15:01:21.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.026+0000 7f76d1288640 1 -- 10.20.193.21:0/3919593989 learned_addr learned my addr 10.20.193.21:0/3919593989 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f76b9ffb640 10 client.?.objecter ms_handle_connect 0x7f76cc058070 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f76b9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3586629850 0 0) 0x7f88a80aee70 con 0x7f88a8166f60 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 >> v1:10.20.193.31:6789/0 conn(0x7f88a815d070 legacy=0x7f88a8146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 >> v1:10.20.193.21:6789/0 conn(0x7f88a815d440 legacy=0x7f88a80ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 1 monclient: found mon.c 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a80af150 con 0x7f88a8166f60 2026-02-25T15:01:21.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 5 monclient: authenticate success, global_id 4568 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _renew_subs 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88a8146430 con 0x7f88a8166f60 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 client.4568.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _renew_subs 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f88a80ae760 con 0x7f88a8166f60 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 1 librados: init done 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.028+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a815b510 con 0x7f88a8166f60 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809806101 0 0) 0x7f76cc0b0710 con 0x7f76cc058070 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 10 monclient(hunting): my global_id is 4571 2026-02-25T15:01:21.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.029+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f769c003610 con 0x7f76cc058070 2026-02-25T15:01:21.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.034+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4108802828 0 0) 0x7f769c003610 con 0x7f76cc058070 2026-02-25T15:01:21.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.034+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76cc0b0710 con 0x7f76cc058070 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03580048d0 con 0x7f0370157b50 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0358004c60 con 0x7f0370157b50 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f034f7fe640 10 monclient: dump: 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.037+0000 7f036d573640 4 set_mon_vals no callback set 2026-02-25T15:01:21.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.038+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0358004e40 con 0x7f0370157b50 2026-02-25T15:01:21.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.039+0000 7f036ed76640 10 monclient: get_auth_request con 0x7f033c079e60 auth_method 0 2026-02-25T15:01:21.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.039+0000 7f034f7fe640 10 client.4561.objecter ms_handle_connect 0x7f033c079e60 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0358095c10 con 0x7f0370157b50 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7f034f7fe640 10 client.4561.objecter ms_dispatch2 0x7f0370000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7f034f7fe640 3 client.4561.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7f034f7fe640 3 client.4561.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7f034f7fe640 20 client.4561.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe720003380 con 0x7fe72c164d00 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe7200050a0 con 0x7fe72c164d00 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 10 monclient: dump: 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.043 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe729ffb640 4 set_mon_vals no callback set 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.042+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe72001e580 con 0x7fe72c164d00 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.043+0000 7fe72b7fe640 10 monclient: get_auth_request con 0x7fe6fc079ea0 auth_method 0 2026-02-25T15:01:21.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.043+0000 7fe707fff640 10 client.4563.objecter ms_handle_connect 0x7fe6fc079ea0 2026-02-25T15:01:21.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.044+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f03700b0ac0 con 0x7f0370157b50 2026-02-25T15:01:21.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.044+0000 7f034f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.044+0000 7f034f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7fe720095e20 con 0x7fe72c164d00 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 10 client.4563.objecter ms_dispatch2 0x7fe72c000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 3 client.4563.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 3 client.4563.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 20 client.4563.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe72005f780 con 0x7fe72c164d00 2026-02-25T15:01:21.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.045+0000 7fe707fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.047+0000 7f0fb2ffd640 1 -- 10.20.193.21:0/2588245728 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 737253363) 0x7f0fc005ee70 con 0x7f0fcc0b0ca0 2026-02-25T15:01:21.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.047+0000 7f0fb2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:21.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.047+0000 7f0fb2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.048 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:21.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.048+0000 7f76b9ffb640 10 client.?.objecter ms_handle_connect 0x7f76cc159e40 2026-02-25T15:01:21.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.048+0000 7f76b9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.048+0000 7f59e929f640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.048+0000 7f59e929f640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.048+0000 7f59e929f640 10 monclient: monmap: 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.049446+0000 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.049446+0000 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 1 Processor -- start 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 1 -- start start 2026-02-25T15:01:21.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient: init 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-b con 0x7f59e40b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-a con 0x7f59e40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-c con 0x7f59e40585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4163930 con 0x7f59e40ba350 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4163bb0 con 0x7f59e40b9f80 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4163e90 con 0x7f59e40585e0 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.049+0000 7f59e929f640 10 monclient(hunting): authenticate will time out at 3024.641879s 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 10 librados: watch_flush enter 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 10 librados: watch_flush exit 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 20 client.4552.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 10 client.4552.objecter successfully canceled tick 2026-02-25T15:01:21.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 >> v1:10.20.193.72:6800/2463505645 conn(0x7f0f98079e60 legacy=0x7f0f9809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 10 monclient: shutdown 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 >> v1:10.20.193.31:6789/0 conn(0x7f0fcc0b0ca0 legacy=0x7f0fcc15ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f76b9ffb640 10 client.?.objecter ms_handle_connect 0x7f76cc159a70 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f76b9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 shutdown_connections 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 >> 10.20.193.21:0/2588245728 conn(0x7f0fcc0b5290 msgr2=0x7f0fcc157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 shutdown_connections 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 -- 10.20.193.21:0/2588245728 wait complete. 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f0fd0c6a640 1 librados: shutdown 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f59e27fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f59e40ba350 0x7f59e4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46842/0 (socket says 10.20.193.21:46842) 2026-02-25T15:01:21.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.050+0000 7f59e27fc640 1 -- 10.20.193.21:0/2614809191 learned_addr learned my addr 10.20.193.21:0/2614809191 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.055 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-25T15:01:21.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.10 2026-02-25T15:01:21.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.088+0000 7f5a46f3a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:21.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.088+0000 7f5a46f3a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:21.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.088+0000 7f5a46f3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.089 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.088+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5a4005e250 con 0x7f5a40157b50 2026-02-25T15:01:21.096 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-25T15:01:21.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.118+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f76bc0030b0 con 0x7f76cc058070 2026-02-25T15:01:21.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.118+0000 7f76b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.118+0000 7f76b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.118+0000 7f76b9ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.119 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.120 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.118+0000 7f76b9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 10 monclient: monmap: 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.121124+0000 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.121124+0000 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.121 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 1 Processor -- start 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 1 -- start start 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.120+0000 7f79c9933640 10 monclient: init 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-a con 0x7f79c40b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-c con 0x7f79c40ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-b con 0x7f79c40585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c4163930 con 0x7f79c40b9f80 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c4163bb0 con 0x7f79c40585e0 2026-02-25T15:01:21.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c4163e90 con 0x7f79c40ba350 2026-02-25T15:01:21.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c9933640 10 monclient(hunting): authenticate will time out at 3024.713482s 2026-02-25T15:01:21.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c2ffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f79c40b9f80 0x7f79c4163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46858/0 (socket says 10.20.193.21:46858) 2026-02-25T15:01:21.123 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.121+0000 7f79c2ffd640 1 -- 10.20.193.21:0/706020859 learned_addr learned my addr 10.20.193.21:0/706020859 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.124 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f889c003950 con 0x7f88a8166f60 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f889c004f10 con 0x7f88a8166f60 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a4ff9640 10 monclient: dump: 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.124 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.123+0000 7f88a67fc640 4 set_mon_vals no callback set 2026-02-25T15:01:21.125 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.124+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f889c01e3f0 con 0x7f88a8166f60 2026-02-25T15:01:21.126 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-25T15:01:21.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.124+0000 7f88a7fff640 10 monclient: get_auth_request con 0x7f8878079fc0 auth_method 0 2026-02-25T15:01:21.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 10 client.4568.objecter ms_handle_connect 0x7f8878079fc0 2026-02-25T15:01:21.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f889c095fd0 con 0x7f88a8166f60 2026-02-25T15:01:21.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 10 client.4568.objecter ms_dispatch2 0x7f88a8000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 3 client.4568.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 3 client.4568.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.125+0000 7f88a4ff9640 20 client.4568.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.126+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f889c05f930 con 0x7f88a8166f60 2026-02-25T15:01:21.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.126+0000 7f88a4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.130 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.126+0000 7f88a4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.130 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4147288336 0 0) 0x7f76cc0b0710 con 0x7f76cc058070 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 >> v1:10.20.193.31:6789/0 conn(0x7f76cc159a70 legacy=0x7f76cc143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 >> v1:10.20.193.21:6789/0 conn(0x7f76cc159e40 legacy=0x7f76cc165c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 1 monclient: found mon.c 2026-02-25T15:01:21.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc0b09f0 con 0x7f76cc058070 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 5 monclient: authenticate success, global_id 4571 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _renew_subs 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc0b0cd0 con 0x7f76cc058070 2026-02-25T15:01:21.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 client.4571.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _renew_subs 2026-02-25T15:01:21.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f76cc0afc90 con 0x7f76cc058070 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 1 librados: init done 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.131+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc0b7f60 con 0x7f76cc058070 2026-02-25T15:01:21.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.153+0000 7f037527b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:21.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.153+0000 7f037527b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:21.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.153+0000 7f037527b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.153+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f03701649c0 con 0x7f0370157b50 2026-02-25T15:01:21.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.155+0000 7f034f7fe640 1 -- 10.20.193.21:0/3932753813 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 737253363) 0x7f035805f570 con 0x7f0370157b50 2026-02-25T15:01:21.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.155+0000 7f034f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:21.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.155+0000 7f034f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.158 INFO:teuthology.orchestra.run.trial021.stdout:94489280515 2026-02-25T15:01:21.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7fe731cfa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:21.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7fe731cfa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:21.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7fe731cfa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe72c0b35a0 con 0x7fe72c164d00 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 10 librados: watch_flush enter 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 10 librados: watch_flush exit 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 20 client.4561.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 10 client.4561.objecter successfully canceled tick 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 >> v1:10.20.193.72:6800/2463505645 conn(0x7f033c079e60 legacy=0x7f033c09a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 10 monclient: shutdown 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 >> v1:10.20.193.31:6789/0 conn(0x7f0370157b50 legacy=0x7f037005c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 shutdown_connections 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 >> 10.20.193.21:0/3932753813 conn(0x7f03700b2ef0 msgr2=0x7f0370058bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 shutdown_connections 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 -- 10.20.193.21:0/3932753813 wait complete. 2026-02-25T15:01:21.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.158+0000 7f037527b640 1 librados: shutdown 2026-02-25T15:01:21.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 10 monclient: monmap: 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.162904+0000 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.162904+0000 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.164 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.165 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 1 Processor -- start 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 1 -- start start 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.162+0000 7f473fa01640 10 monclient: init 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-c con 0x7f4738159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-b con 0x7f4738165880 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-a con 0x7f4738056090 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473815a170 con 0x7f4738056090 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47380b4650 con 0x7f4738165880 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47380b4930 con 0x7f4738159da0 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.163+0000 7f473fa01640 10 monclient(hunting): authenticate will time out at 3024.755212s 2026-02-25T15:01:21.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.3 2026-02-25T15:01:21.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.183+0000 7f473cf75640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f4738165880 0x7f4738055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47526/0 (socket says 10.20.193.21:47526) 2026-02-25T15:01:21.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.184+0000 7f473cf75640 1 -- 10.20.193.21:0/2264745471 learned_addr learned my addr 10.20.193.21:0/2264745471 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286385869 0 0) 0x7f79c4163bb0 con 0x7f79c40585e0 2026-02-25T15:01:21.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): my global_id is 4570 2026-02-25T15:01:21.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b0003610 con 0x7f79c40585e0 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808428675 0 0) 0x7f59e4163bb0 con 0x7f59e40b9f80 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 10 monclient(hunting): my global_id is 4567 2026-02-25T15:01:21.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d0003610 con 0x7f59e40b9f80 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958283527 0 0) 0x7f79b8002910 con 0x7f79c40b9f80 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 10 monclient(hunting): my global_id is 4569 2026-02-25T15:01:21.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.189+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79c4163bb0 con 0x7f79c40b9f80 2026-02-25T15:01:21.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7fe707fff640 1 -- 10.20.193.21:0/1221788638 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1257367751) 0x7fe72005f080 con 0x7fe72c164d00 2026-02-25T15:01:21.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7fe707fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-25T15:01:21.194 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7fe707fff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.194 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329151594 0 0) 0x7f59cc002910 con 0x7f59e40ba350 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 10 monclient(hunting): my global_id is 4566 2026-02-25T15:01:21.195 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4163bb0 con 0x7f59e40ba350 2026-02-25T15:01:21.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f3c2b9b1640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f3c2b9b1640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.197 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.191+0000 7f3c2b9b1640 10 monclient: monmap: 2026-02-25T15:01:21.197 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.192645+0000 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.192645+0000 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 1 Processor -- start 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 1 -- start start 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient: init 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-b con 0x7f3c2415d610 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-c con 0x7f3c241667e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-a con 0x7f3c24056ea0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2415d9e0 con 0x7f3c24056ea0 2026-02-25T15:01:21.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24055b20 con 0x7f3c2415d610 2026-02-25T15:01:21.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24055e00 con 0x7f3c241667e0 2026-02-25T15:01:21.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.192+0000 7f3c2b9b1640 10 monclient(hunting): authenticate will time out at 3024.784977s 2026-02-25T15:01:21.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.193+0000 7f3c29726640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3c2415d610 0x7f3c240b9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47536/0 (socket says 10.20.193.21:47536) 2026-02-25T15:01:21.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.193+0000 7f3c29726640 1 -- 10.20.193.21:0/3653555767 learned_addr learned my addr 10.20.193.21:0/3653555767 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 10 librados: watch_flush enter 2026-02-25T15:01:21.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 10 librados: watch_flush exit 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 20 client.4563.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 10 client.4563.objecter successfully canceled tick 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe6fc079ea0 legacy=0x7fe6fc09a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 10 monclient: shutdown 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 >> v1:10.20.193.21:6789/0 conn(0x7fe72c164d00 legacy=0x7fe72c12b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 shutdown_connections 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 >> 10.20.193.21:0/1221788638 conn(0x7fe72c0b2ef0 msgr2=0x7fe72c156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 shutdown_connections 2026-02-25T15:01:21.202 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 -- 10.20.193.21:0/1221788638 wait complete. 2026-02-25T15:01:21.203 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.194+0000 7fe731cfa640 1 librados: shutdown 2026-02-25T15:01:21.204 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.195+0000 7f29e36f3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.204 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.195+0000 7f29e36f3640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.204 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.195+0000 7f29e36f3640 10 monclient: monmap: 2026-02-25T15:01:21.204 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.204 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.196581+0000 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.196581+0000 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 1 Processor -- start 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 1 -- start start 2026-02-25T15:01:21.205 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient: init 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-c con 0x7f29dc0b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-b con 0x7f29dc0ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-a con 0x7f29dc0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc163930 con 0x7f29dc0585e0 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc163bb0 con 0x7f29dc0ba350 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc163e90 con 0x7f29dc0b9f80 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.196+0000 7f29e36f3640 10 monclient(hunting): authenticate will time out at 3024.788939s 2026-02-25T15:01:21.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f29e0c67640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f29dc0ba350 0x7f29dc057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47550/0 (socket says 10.20.193.21:47550) 2026-02-25T15:01:21.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f29e0c67640 1 -- 10.20.193.21:0/2863087583 learned_addr learned my addr 10.20.193.21:0/2863087583 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 10 monclient: monmap: 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.198031+0000 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.198031+0000 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.209 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 1 Processor -- start 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 1 -- start start 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.197+0000 7f0ff9d4d640 10 monclient: init 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-a con 0x7f0ff40b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-b con 0x7f0ff40ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-c con 0x7f0ff40585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff4163930 con 0x7f0ff40b9f80 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff4163bb0 con 0x7f0ff40ba350 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff4163e90 con 0x7f0ff40585e0 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff9d4d640 10 monclient(hunting): authenticate will time out at 3024.790333s 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff2ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f0ff40ba350 0x7f0ff4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47560/0 (socket says 10.20.193.21:47560) 2026-02-25T15:01:21.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.198+0000 7f0ff2ffd640 1 -- 10.20.193.21:0/3375855950 learned_addr learned my addr 10.20.193.21:0/3375855950 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.4 2026-02-25T15:01:21.212 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.237 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.236+0000 7f88ae313640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:21.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.236+0000 7f88ae313640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:21.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.236+0000 7f88ae313640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.236+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f88a815b230 con 0x7f88a8166f60 2026-02-25T15:01:21.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869408677 0 0) 0x7f79c4163e90 con 0x7f79c40ba350 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 10 monclient(hunting): my global_id is 4574 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b8002910 con 0x7f79c40ba350 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f5a357fa640 1 -- 10.20.193.21:0/3568101383 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 521551722) 0x7f5a4005e250 con 0x7f5a40157b50 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f5a357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-25T15:01:21.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.246+0000 7f5a357fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.249 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 10 librados: watch_flush enter 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 10 librados: watch_flush exit 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 20 client.4559.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 10 client.4559.objecter successfully canceled tick 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 >> v1:10.20.193.72:6800/2463505645 conn(0x7f5a10079e60 legacy=0x7f5a1009a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 10 monclient: shutdown 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.248+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 >> v1:10.20.193.68:6789/0 conn(0x7f5a40157b50 legacy=0x7f5a4012e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.249+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 shutdown_connections 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.249+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 >> 10.20.193.21:0/3568101383 conn(0x7f5a400b2ef0 msgr2=0x7f5a40156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.249+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 shutdown_connections 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.249+0000 7f5a46f3a640 1 -- 10.20.193.21:0/3568101383 wait complete. 2026-02-25T15:01:21.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.249+0000 7f5a46f3a640 1 librados: shutdown 2026-02-25T15:01:21.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76bc004950 con 0x7f76cc058070 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f76bc004ca0 con 0x7f76cc058070 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 10 monclient: dump: 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.257 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76bb7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:21.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.255+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f76bc01e180 con 0x7f76cc058070 2026-02-25T15:01:21.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.256+0000 7f76d0a87640 10 monclient: get_auth_request con 0x7f769c079da0 auth_method 0 2026-02-25T15:01:21.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.256+0000 7f76b9ffb640 10 client.4571.objecter ms_handle_connect 0x7f769c079da0 2026-02-25T15:01:21.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.6 2026-02-25T15:01:21.261 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.257+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f76bc095d10 con 0x7f76cc058070 2026-02-25T15:01:21.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.257+0000 7f76b9ffb640 10 client.4571.objecter ms_dispatch2 0x7f76cc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.257+0000 7f76b9ffb640 3 client.4571.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.257+0000 7f76b9ffb640 3 client.4571.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.257+0000 7f76b9ffb640 20 client.4571.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582649149 0 0) 0x7f59e4163e90 con 0x7f59e40585e0 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 10 monclient(hunting): my global_id is 4577 2026-02-25T15:01:21.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.263+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59cc002910 con 0x7f59e40585e0 2026-02-25T15:01:21.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.265+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f76bc05f670 con 0x7f76cc058070 2026-02-25T15:01:21.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.265+0000 7f76b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.265+0000 7f76b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942539910 0 0) 0x7f473815a170 con 0x7f4738056090 2026-02-25T15:01:21.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 10 monclient(hunting): my global_id is 4572 2026-02-25T15:01:21.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4720003610 con 0x7f4738056090 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899270022 0 0) 0x7f3c2415d9e0 con 0x7f3c24056ea0 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f3c13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f3c13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f3c13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.305+0000 7f3c13fff640 10 monclient(hunting): my global_id is 4575 2026-02-25T15:01:21.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c0c003610 con 0x7f3c24056ea0 2026-02-25T15:01:21.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1343893470 0 0) 0x7f79c4163bb0 con 0x7f79c40b9f80 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 >> v1:10.20.193.68:6789/0 conn(0x7f79c40ba350 legacy=0x7f79c4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 >> v1:10.20.193.31:6789/0 conn(0x7f79c40585e0 legacy=0x7f79c4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40573f0 con 0x7f79c40b9f80 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f79b8002fc0 con 0x7f79c40b9f80 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c1ffb640 10 monclient: dump: 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.312 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c9933640 5 monclient: authenticate success, global_id 4569 2026-02-25T15:01:21.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f79c9933640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528311075 0 0) 0x7f29d8002c90 con 0x7f29dc0585e0 2026-02-25T15:01:21.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 10 monclient(hunting): my global_id is 4578 2026-02-25T15:01:21.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c4003610 con 0x7f29dc0585e0 2026-02-25T15:01:21.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931849494 0 0) 0x7f0fe0002910 con 0x7f0ff40b9f80 2026-02-25T15:01:21.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 10 monclient(hunting): my global_id is 4581 2026-02-25T15:01:21.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fd8003610 con 0x7f0ff40b9f80 2026-02-25T15:01:21.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 575314842 0 0) 0x7f59e4163bb0 con 0x7f59e40ba350 2026-02-25T15:01:21.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 >> v1:10.20.193.68:6789/0 conn(0x7f59e40585e0 legacy=0x7f59e4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 >> v1:10.20.193.31:6789/0 conn(0x7f59e40b9f80 legacy=0x7f59e4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40573f0 con 0x7f59e40ba350 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59cc002fc0 con 0x7f59e40ba350 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e1ffb640 10 monclient: dump: 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.319 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e929f640 5 monclient: authenticate success, global_id 4566 2026-02-25T15:01:21.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.306+0000 7f59e929f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433474994 0 0) 0x7f47380b4650 con 0x7f4738165880 2026-02-25T15:01:21.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 10 monclient(hunting): my global_id is 4573 2026-02-25T15:01:21.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f473815a170 con 0x7f4738165880 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400794205 0 0) 0x7f0ff4163bb0 con 0x7f0ff40ba350 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 10 monclient(hunting): my global_id is 4582 2026-02-25T15:01:21.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe0002910 con 0x7f0ff40ba350 2026-02-25T15:01:21.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f88a4ff9640 1 -- 10.20.193.21:0/3213451654 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 521551722) 0x7f889c05f230 con 0x7f88a8166f60 2026-02-25T15:01:21.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f88a4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-25T15:01:21.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.308+0000 7f88a4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.324 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035551418 0 0) 0x7f29dc163bb0 con 0x7f29dc0ba350 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 10 monclient(hunting): my global_id is 4579 2026-02-25T15:01:21.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29d8002c90 con 0x7f29dc0ba350 2026-02-25T15:01:21.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331242174 0 0) 0x7f3c24055b20 con 0x7f3c2415d610 2026-02-25T15:01:21.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): my global_id is 4576 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c2415d9e0 con 0x7f3c2415d610 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228746921 0 0) 0x7f3c24055e00 con 0x7f3c241667e0 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 10 monclient(hunting): my global_id is 4583 2026-02-25T15:01:21.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.309+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c24055b20 con 0x7f3c241667e0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4033983186 0 0) 0x7f3c0c003610 con 0x7f3c24056ea0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 >> v1:10.20.193.68:6789/0 conn(0x7f3c241667e0 legacy=0x7f3c240ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 >> v1:10.20.193.31:6789/0 conn(0x7f3c2415d610 legacy=0x7f3c240b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240560e0 con 0x7f3c24056ea0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3c20003170 con 0x7f3c24056ea0 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c13fff640 10 monclient: dump: 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.329 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.330 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.330 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c2b9b1640 5 monclient: authenticate success, global_id 4575 2026-02-25T15:01:21.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f3c2b9b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814567143 0 0) 0x7f47380b4930 con 0x7f4738159da0 2026-02-25T15:01:21.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 10 monclient(hunting): my global_id is 4580 2026-02-25T15:01:21.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.310+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47380b4650 con 0x7f4738159da0 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173456696 0 0) 0x7f29dc163e90 con 0x7f29dc0b9f80 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 10 monclient(hunting): my global_id is 4586 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29dc163bb0 con 0x7f29dc0b9f80 2026-02-25T15:01:21.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966853587 0 0) 0x7f0ff4163e90 con 0x7f0ff40585e0 2026-02-25T15:01:21.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 10 monclient(hunting): my global_id is 4589 2026-02-25T15:01:21.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff4163bb0 con 0x7f0ff40585e0 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f79b8003190 con 0x7f79c40b9f80 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 1 -- 10.20.193.21:0/706020859 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f79b8004990 con 0x7f79c40b9f80 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c1ffb640 10 monclient: dump: 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.334 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c9933640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f79c9933640 4 set_mon_vals no callback set 2026-02-25T15:01:21.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 10 librados: watch_flush enter 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 10 librados: watch_flush exit 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 20 client.4568.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 10 client.4568.objecter successfully canceled tick 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 >> v1:10.20.193.72:6800/2463505645 conn(0x7f8878079fc0 legacy=0x7f887809a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 10 monclient: shutdown 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 >> v1:10.20.193.68:6789/0 conn(0x7f88a8166f60 legacy=0x7f88a81578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 shutdown_connections 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 >> 10.20.193.21:0/3213451654 conn(0x7f88a80b2ef0 msgr2=0x7f88a805b660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 shutdown_connections 2026-02-25T15:01:21.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 -- 10.20.193.21:0/3213451654 wait complete. 2026-02-25T15:01:21.338 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.311+0000 7f88ae313640 1 librados: shutdown 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 10 monclient: shutdown 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 1 -- 10.20.193.21:0/706020859 >> v1:10.20.193.21:6789/0 conn(0x7f79c40b9f80 legacy=0x7f79c4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 1 -- 10.20.193.21:0/706020859 shutdown_connections 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 1 -- 10.20.193.21:0/706020859 >> 10.20.193.21:0/706020859 conn(0x7f79c40b7990 msgr2=0x7f79c40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 1 -- 10.20.193.21:0/706020859 shutdown_connections 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 1 -- 10.20.193.21:0/706020859 wait complete. 2026-02-25T15:01:21.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.312+0000 7f79c9933640 10 monclient: monmap: 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 librados: starting msgr at 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 librados: starting objecter 2026-02-25T15:01:21.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 Processor -- start 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 -- start start 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 librados: setting wanted keys 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 librados: calling monclient init 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient: init 2026-02-25T15:01:21.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533938568 0 0) 0x7f4720003610 con 0x7f4738056090 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 >> v1:10.20.193.68:6789/0 conn(0x7f4738159da0 legacy=0x7f4738165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 >> v1:10.20.193.31:6789/0 conn(0x7f4738165880 legacy=0x7f4738055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47380b4c10 con 0x7f4738056090 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4734003170 con 0x7f4738056090 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f4727fff640 10 monclient: dump: 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f473fa01640 5 monclient: authenticate success, global_id 4572 2026-02-25T15:01:21.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f473fa01640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-b con 0x7f79c40585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-c con 0x7f79c40b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient(hunting): picked mon.noname-a con 0x7f79c40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c41669a0 con 0x7f79c40ba350 2026-02-25T15:01:21.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c41fe7f0 con 0x7f79c40585e0 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c40af280 con 0x7f79c40b9f80 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.313+0000 7f79c9933640 10 monclient(hunting): authenticate will time out at 3024.905682s 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069981458 0 0) 0x7f29c4003610 con 0x7f29dc0585e0 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 >> v1:10.20.193.68:6789/0 conn(0x7f29dc0b9f80 legacy=0x7f29dc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 >> v1:10.20.193.31:6789/0 conn(0x7f29dc0ba350 legacy=0x7f29dc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc0573f0 con 0x7f29dc0585e0 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f29d8003340 con 0x7f29dc0585e0 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29cbfff640 10 monclient: dump: 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.346 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29e36f3640 5 monclient: authenticate success, global_id 4578 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f29e36f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249849357 0 0) 0x7f0fd8003610 con 0x7f0ff40b9f80 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 >> v1:10.20.193.68:6789/0 conn(0x7f0ff40585e0 legacy=0x7f0ff4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 >> v1:10.20.193.31:6789/0 conn(0x7f0ff40ba350 legacy=0x7f0ff4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 monclient: found mon.noname-a 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40573f0 con 0x7f0ff40b9f80 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fe0002fc0 con 0x7f0ff40b9f80 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff27fc640 10 monclient: dump: 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.348 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff9d4d640 5 monclient: authenticate success, global_id 4581 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.314+0000 7f0ff9d4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59cc003190 con 0x7f59e40ba350 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 1 -- 10.20.193.21:0/2614809191 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59cc004990 con 0x7f59e40ba350 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e1ffb640 10 monclient: dump: 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 4 set_mon_vals no callback set 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f79c2ffd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f79c40585e0 0x7f79c4166290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47574/0 (socket says 10.20.193.21:47574) 2026-02-25T15:01:21.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f79c2ffd640 1 -- 10.20.193.21:0/1757156887 learned_addr learned my addr 10.20.193.21:0/1757156887 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 10 monclient: shutdown 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 1 -- 10.20.193.21:0/2614809191 >> v1:10.20.193.21:6789/0 conn(0x7f59e40ba350 legacy=0x7f59e4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 1 -- 10.20.193.21:0/2614809191 shutdown_connections 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 1 -- 10.20.193.21:0/2614809191 >> 10.20.193.21:0/2614809191 conn(0x7f59e40b7990 msgr2=0x7f59e40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 1 -- 10.20.193.21:0/2614809191 shutdown_connections 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.316+0000 7f59e929f640 1 -- 10.20.193.21:0/2614809191 wait complete. 2026-02-25T15:01:21.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f799bfff640 10 client.?.objecter ms_handle_connect 0x7f79c40585e0 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f799bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c20003340 con 0x7f3c24056ea0 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 1 -- 10.20.193.21:0/3653555767 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3c20003780 con 0x7f3c24056ea0 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 4 set_mon_vals no callback set 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c13fff640 10 monclient: dump: 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.352 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 10 monclient: monmap: 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.353 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 10 monclient: shutdown 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3653555767 >> v1:10.20.193.21:6789/0 conn(0x7f3c24056ea0 legacy=0x7f3c241c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3653555767 shutdown_connections 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3653555767 >> 10.20.193.21:0/3653555767 conn(0x7f3c240b7470 msgr2=0x7f3c240b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3653555767 shutdown_connections 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3653555767 wait complete. 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 librados: starting msgr at 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 librados: starting objecter 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 Processor -- start 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 -- start start 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 librados: setting wanted keys 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 1 librados: calling monclient init 2026-02-25T15:01:21.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f59e929f640 10 monclient: init 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.317+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29d8003510 con 0x7f29dc0585e0 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29cbfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29cbfff640 1 -- 10.20.193.21:0/2863087583 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f29d8003a80 con 0x7f29dc0585e0 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29cbfff640 10 monclient: dump: 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 4 set_mon_vals no callback set 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient: monmap: 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.357 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4734003340 con 0x7f4738056090 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 1 -- 10.20.193.21:0/2264745471 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4734003780 con 0x7f4738056090 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f4727fff640 10 monclient: dump: 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.358 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 4 set_mon_vals no callback set 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 librados: starting msgr at 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 librados: starting objecter 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-a con 0x7f59e40585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-c con 0x7f59e40b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient(hunting): picked mon.noname-b con 0x7f59e40ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40b3ef0 con 0x7f59e40585e0 2026-02-25T15:01:21.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40b41d0 con 0x7f59e40ba350 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40b44b0 con 0x7f59e40b9f80 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 Processor -- start 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e929f640 10 monclient(hunting): authenticate will time out at 3024.910306s 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 10 monclient: shutdown 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 1 -- 10.20.193.21:0/2863087583 >> v1:10.20.193.21:6789/0 conn(0x7f29dc0585e0 legacy=0x7f29dc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934734957 0 0) 0x7f79c41fe7f0 con 0x7f79c40585e0 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 monclient(hunting): my global_id is 4585 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 1 -- 10.20.193.21:0/2863087583 shutdown_connections 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 1 -- 10.20.193.21:0/2863087583 >> 10.20.193.21:0/2863087583 conn(0x7f29dc0b7990 msgr2=0x7f29dc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7994003610 con 0x7f79c40585e0 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 -- start start 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 librados: setting wanted keys 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 librados: calling monclient init 2026-02-25T15:01:21.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient: init 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 1 -- 10.20.193.21:0/2863087583 shutdown_connections 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 1 -- 10.20.193.21:0/2863087583 wait complete. 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 10 monclient: shutdown 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 1 -- 10.20.193.21:0/2264745471 >> v1:10.20.193.21:6789/0 conn(0x7f4738056090 legacy=0x7f47380b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 1 -- 10.20.193.21:0/2264745471 shutdown_connections 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 1 -- 10.20.193.21:0/2264745471 >> 10.20.193.21:0/2264745471 conn(0x7f47380b78c0 msgr2=0x7f47380b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 1 -- 10.20.193.21:0/2264745471 shutdown_connections 2026-02-25T15:01:21.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f473fa01640 1 -- 10.20.193.21:0/2264745471 wait complete. 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-a con 0x7f3c24056ea0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-c con 0x7f3c2415d610 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient(hunting): picked mon.noname-b con 0x7f3c241667e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24138620 con 0x7f3c24056ea0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c241388e0 con 0x7f3c241667e0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24138bc0 con 0x7f3c2415d610 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f3c2b9b1640 10 monclient(hunting): authenticate will time out at 3024.910753s 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f29e36f3640 10 monclient: monmap: 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.363 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 client.?.objecter ms_handle_connect 0x7f79c40ba350 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f799bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e37fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f59e40ba350 0x7f59e4165c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47586/0 (socket says 10.20.193.21:47586) 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.318+0000 7f59e37fe640 1 -- 10.20.193.21:0/3576880262 learned_addr learned my addr 10.20.193.21:0/3576880262 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 librados: starting msgr at 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 librados: starting objecter 2026-02-25T15:01:21.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 10 monclient: monmap: 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 Processor -- start 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 -- start start 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 librados: setting wanted keys 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 librados: calling monclient init 2026-02-25T15:01:21.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient: init 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 librados: starting msgr at 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 librados: starting objecter 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 Processor -- start 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 -- start start 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 librados: setting wanted keys 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 1 librados: calling monclient init 2026-02-25T15:01:21.366 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f473fa01640 10 monclient: init 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-c con 0x7f29dc0585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-b con 0x7f29dc0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient(hunting): picked mon.noname-a con 0x7f29dc0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc1fb9b0 con 0x7f29dc0ba350 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc1fbc90 con 0x7f29dc0b9f80 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29dc165bb0 con 0x7f29dc0585e0 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.319+0000 7f29e36f3640 10 monclient(hunting): authenticate will time out at 3024.911800s 2026-02-25T15:01:21.367 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-b con 0x7f4738056090 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-c con 0x7f4738159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient(hunting): picked mon.noname-a con 0x7f4738165880 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47380b3f00 con 0x7f4738165880 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47381fcb50 con 0x7f4738056090 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47381fce10 con 0x7f4738159da0 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.320+0000 7f473fa01640 10 monclient(hunting): authenticate will time out at 3024.912367s 2026-02-25T15:01:21.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.13 2026-02-25T15:01:21.368 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f59c37fe640 10 client.?.objecter ms_handle_connect 0x7f59e40ba350 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f59c37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c29f27640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3c241667e0 0x7f3c241658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47592/0 (socket says 10.20.193.21:47592) 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c29f27640 1 -- 10.20.193.21:0/3133469540 learned_addr learned my addr 10.20.193.21:0/3133469540 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.369 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 client.?.objecter ms_handle_connect 0x7f79c40b9f80 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2369289538 0 0) 0x7f7994003610 con 0x7f79c40585e0 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f79c41fe7f0 con 0x7f79c40585e0 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f79b8002d30 con 0x7f79c40585e0 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 monclient(hunting): dump: 2026-02-25T15:01:21.369 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f799bfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c11ffb640 10 client.?.objecter ms_handle_connect 0x7f3c241667e0 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c11ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f59c37fe640 10 client.?.objecter ms_handle_connect 0x7f59e40585e0 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f59c37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c11ffb640 10 client.?.objecter ms_handle_connect 0x7f3c24056ea0 2026-02-25T15:01:21.370 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.321+0000 7f3c11ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fe0003190 con 0x7f0ff40b9f80 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 1 -- 10.20.193.21:0/3375855950 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fe0003700 con 0x7f0ff40b9f80 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff27fc640 10 monclient: dump: 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 4 set_mon_vals no callback set 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f29e1468640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f29dc0585e0 0x7f29dc1fee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54524/0 (socket says 10.20.193.21:54524) 2026-02-25T15:01:21.371 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f29e1468640 1 -- 10.20.193.21:0/769868539 learned_addr learned my addr 10.20.193.21:0/769868539 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 10 monclient: shutdown 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/3375855950 >> v1:10.20.193.21:6789/0 conn(0x7f0ff40b9f80 legacy=0x7f0ff4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/3375855950 shutdown_connections 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/3375855950 >> 10.20.193.21:0/3375855950 conn(0x7f0ff40b7990 msgr2=0x7f0ff40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/3375855950 shutdown_connections 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/3375855950 wait complete. 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f3c11ffb640 10 client.?.objecter ms_handle_connect 0x7f3c2415d610 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f3c11ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987270920 0 0) 0x7f59e40b41d0 con 0x7f59e40ba350 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 10 monclient(hunting): my global_id is 4588 2026-02-25T15:01:21.372 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.322+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b0003610 con 0x7f59e40ba350 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f29c9ffb640 10 client.?.objecter ms_handle_connect 0x7f29dc0585e0 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f29c9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient: monmap: 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f59c37fe640 10 client.?.objecter ms_handle_connect 0x7f59e40b9f80 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f59c37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.373 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 librados: starting msgr at 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 librados: starting objecter 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496072467 0 0) 0x7f79c41669a0 con 0x7f79c40ba350 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 Processor -- start 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 10 monclient(hunting): my global_id is 4584 2026-02-25T15:01:21.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7994003610 con 0x7f79c40ba350 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 -- start start 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 librados: setting wanted keys 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 librados: calling monclient init 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient: init 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-c con 0x7f0ff40585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-b con 0x7f0ff40b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 10 monclient(hunting): picked mon.noname-a con 0x7f0ff40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.323+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40b4ea0 con 0x7f0ff40ba350 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40b23b0 con 0x7f0ff40b9f80 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f0ff9d4d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff40b2690 con 0x7f0ff40585e0 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f0ff9d4d640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f0ff9d4d640 10 monclient(hunting): authenticate will time out at 3024.916017s 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f473df77640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f4738165880 0x7f4738152a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46970/0 (socket says 10.20.193.21:46970) 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f473df77640 1 -- 10.20.193.21:0/2124290490 learned_addr learned my addr 10.20.193.21:0/2124290490 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723711566 0 0) 0x7f3c24138bc0 con 0x7f3c2415d610 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 10 monclient(hunting): my global_id is 4595 2026-02-25T15:01:21.375 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.324+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf4003610 con 0x7f3c2415d610 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1130174281 0 0) 0x7f79c41fe7f0 con 0x7f79c40585e0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 >> v1:10.20.193.68:6789/0 conn(0x7f79c40b9f80 legacy=0x7f79c41fe0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 >> v1:10.20.193.21:6789/0 conn(0x7f79c40ba350 legacy=0x7f79c40b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 1 monclient: found mon.b 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c40af560 con 0x7f79c40585e0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f799bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 5 monclient: authenticate success, global_id 4585 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _renew_subs 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f79c40af840 con 0x7f79c40585e0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 client.4585.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _renew_subs 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f79c40afe00 con 0x7f79c40585e0 2026-02-25T15:01:21.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 1 librados: init done 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f0ff37fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f0ff40585e0 0x7f0ff40b4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54546/0 (socket says 10.20.193.21:54546) 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f0ff37fe640 1 -- 10.20.193.21:0/1110150301 learned_addr learned my addr 10.20.193.21:0/1110150301 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.325+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c40b64c0 con 0x7f79c40585e0 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f4725ffb640 10 client.?.objecter ms_handle_connect 0x7f4738159da0 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f4725ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193996501 0 0) 0x7f29dc165bb0 con 0x7f29dc0585e0 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 monclient(hunting): my global_id is 4601 2026-02-25T15:01:21.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29ac003610 con 0x7f29dc0585e0 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f0fcffff640 10 client.?.objecter ms_handle_connect 0x7f0ff40585e0 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f0fcffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 client.?.objecter ms_handle_connect 0x7f29dc0ba350 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.326+0000 7f29c9ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f4725ffb640 10 client.?.objecter ms_handle_connect 0x7f4738165880 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f4725ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886538142 0 0) 0x7f3c241388e0 con 0x7f3c241667e0 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): my global_id is 4591 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c24138bc0 con 0x7f3c241667e0 2026-02-25T15:01:21.378 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2923449858 0 0) 0x7f59e40b3ef0 con 0x7f59e40585e0 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 10 monclient(hunting): my global_id is 4587 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e40b41d0 con 0x7f59e40585e0 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154660213 0 0) 0x7f3c24138620 con 0x7f3c24056ea0 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 10 monclient(hunting): my global_id is 4590 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.327+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c241388e0 con 0x7f3c24056ea0 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1317101233 0 0) 0x7f59b0003610 con 0x7f59e40ba350 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59e40b3ef0 con 0x7f59e40ba350 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59d4003420 con 0x7f59e40ba350 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.379 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.328+0000 7f59c37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.329+0000 7f0fcffff640 10 client.?.objecter ms_handle_connect 0x7f0ff40ba350 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.329+0000 7f0fcffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2240785303 0 0) 0x7f29ac003610 con 0x7f29dc0585e0 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29dc165bb0 con 0x7f29dc0585e0 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f29cc003170 con 0x7f29dc0585e0 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.380 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f29c9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344581914 0 0) 0x7f0ff40b2690 con 0x7f0ff40585e0 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 10 monclient(hunting): my global_id is 4607 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc4003610 con 0x7f0ff40585e0 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908220175 0 0) 0x7f59e40b44b0 con 0x7f59e40b9f80 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 10 monclient(hunting): my global_id is 4598 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.330+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b0003610 con 0x7f59e40b9f80 2026-02-25T15:01:21.381 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348252232 0 0) 0x7f47380b3f00 con 0x7f4738165880 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 10 monclient(hunting): my global_id is 4596 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4708003610 con 0x7f4738165880 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381046354 0 0) 0x7f29dc1fb9b0 con 0x7f29dc0ba350 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 10 monclient(hunting): my global_id is 4593 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29ac003610 con 0x7f29dc0ba350 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1386019726 0 0) 0x7f3c241388e0 con 0x7f3c24056ea0 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c24138620 con 0x7f3c24056ea0 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3c14002ff0 con 0x7f3c24056ea0 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.382 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.333+0000 7f3c11ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3854908230 0 0) 0x7f59e40b41d0 con 0x7f59e40585e0 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59e40b44b0 con 0x7f59e40585e0 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59d80030b0 con 0x7f59e40585e0 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f59c37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457007704 0 0) 0x7f0ff40b4ea0 con 0x7f0ff40ba350 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.383 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 10 monclient(hunting): my global_id is 4599 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.334+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff40b2690 con 0x7f0ff40ba350 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3286934284 0 0) 0x7f47381fce10 con 0x7f4738159da0 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 10 monclient(hunting): my global_id is 4604 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47380b3f00 con 0x7f4738159da0 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1978701568 0 0) 0x7f3bf4003610 con 0x7f3c2415d610 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c241388e0 con 0x7f3c2415d610 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3c18003060 con 0x7f3c2415d610 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f3c11ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.384 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3338459868 0 0) 0x7f29dc165bb0 con 0x7f29dc0585e0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 >> v1:10.20.193.31:6789/0 conn(0x7f29dc0b9f80 legacy=0x7f29dc156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 >> v1:10.20.193.21:6789/0 conn(0x7f29dc0ba350 legacy=0x7f29dc1faec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 1 monclient: found mon.c 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29dc165e90 con 0x7f29dc0585e0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 5 monclient: authenticate success, global_id 4601 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _renew_subs 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29dc166170 con 0x7f29dc0585e0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 client.4601.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _renew_subs 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f29dc15dd60 con 0x7f29dc0585e0 2026-02-25T15:01:21.385 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 1 librados: init done 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1175749576 0 0) 0x7f0fc4003610 con 0x7f0ff40585e0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ff40b4ea0 con 0x7f0ff40585e0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fe00034e0 con 0x7f0ff40585e0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 10 monclient(hunting): dump: 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f0fcffff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3874741300 0 0) 0x7f59b0003610 con 0x7f59e40b9f80 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59e40b41d0 con 0x7f59e40b9f80 2026-02-25T15:01:21.386 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59cc002ed0 con 0x7f59e40b9f80 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29dc056070 con 0x7f29dc0585e0 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.338+0000 7f59c37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1184016222 0 0) 0x7f4708003610 con 0x7f4738165880 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47381fce10 con 0x7f4738165880 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4734003690 con 0x7f4738165880 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.387 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.340+0000 7f4725ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2147156348 0 0) 0x7f0ff40b2690 con 0x7f0ff40ba350 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fc4003610 con 0x7f0ff40ba350 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fe8003410 con 0x7f0ff40ba350 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f0fcffff640 10 monclient(hunting): dump: 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1840274333 0 0) 0x7f59e40b44b0 con 0x7f59e40585e0 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 >> v1:10.20.193.68:6789/0 conn(0x7f59e40b9f80 legacy=0x7f59e41fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 >> v1:10.20.193.31:6789/0 conn(0x7f59e40ba350 legacy=0x7f59e4165c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 1 monclient: found mon.a 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40b4790 con 0x7f59e40585e0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 5 monclient: authenticate success, global_id 4587 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 10 monclient: _renew_subs 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59e40b4a70 con 0x7f59e40585e0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 10 client.4587.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 10 monclient: _renew_subs 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.344+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59e41fc4a0 con 0x7f59e40585e0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f59e929f640 1 librados: init done 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3376948599 0 0) 0x7f3c24138620 con 0x7f3c24056ea0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 >> v1:10.20.193.68:6789/0 conn(0x7f3c2415d610 legacy=0x7f3c241234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 >> v1:10.20.193.31:6789/0 conn(0x7f3c241667e0 legacy=0x7f3c241658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 1 monclient: found mon.a 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c24138ea0 con 0x7f3c24056ea0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.389 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 5 monclient: authenticate success, global_id 4590 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _renew_subs 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c24139180 con 0x7f3c24056ea0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 client.4590.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _renew_subs 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c24123bc0 con 0x7f3c24056ea0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 1 librados: init done 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1997355704 0 0) 0x7f47380b3f00 con 0x7f4738159da0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4708003610 con 0x7f4738159da0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f472c002fc0 con 0x7f4738159da0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f4725ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f59e929f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f59e929f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f59e929f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e40b64c0 con 0x7f59e40585e0 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.345+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c24154110 con 0x7f3c24056ea0 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.376+0000 7f76d3513640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.376+0000 7f76d3513640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.376+0000 7f76d3513640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.391 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.376+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f76cc0b7c80 con 0x7f76cc058070 2026-02-25T15:01:21.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.418+0000 7f0fcffff640 10 client.?.objecter ms_handle_connect 0x7f0ff40b9f80 2026-02-25T15:01:21.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.418+0000 7f0fcffff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.418+0000 7f4725ffb640 10 client.?.objecter ms_handle_connect 0x7f4738056090 2026-02-25T15:01:21.419 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.418+0000 7f4725ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f79b8003090 con 0x7f79c40585e0 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f79b8005090 con 0x7f79c40585e0 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f79c17fa640 4 set_mon_vals no callback set 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.428+0000 7f799bfff640 10 monclient: dump: 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.429 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f79b801e570 con 0x7f79c40585e0 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f79b8095ea0 con 0x7f79c40585e0 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 10 client.4585.objecter ms_dispatch2 0x7f79c4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 3 client.4585.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 3 client.4585.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f79c27fc640 10 monclient: get_auth_request con 0x7f7994079ff0 auth_method 0 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 20 client.4585.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583308050 0 0) 0x7f47381fcb50 con 0x7f4738056090 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 10 monclient(hunting): my global_id is 4597 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47380b3f00 con 0x7f4738056090 2026-02-25T15:01:21.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.429+0000 7f799bfff640 10 client.4585.objecter ms_handle_connect 0x7f7994079ff0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 282086226 0 0) 0x7f0ff40b4ea0 con 0x7f0ff40585e0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 >> v1:10.20.193.31:6789/0 conn(0x7f0ff40b9f80 legacy=0x7f0ff41fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 >> v1:10.20.193.21:6789/0 conn(0x7f0ff40ba350 legacy=0x7f0ff41fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 1 monclient: found mon.c 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff40b2970 con 0x7f0ff40585e0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0fcffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 5 monclient: authenticate success, global_id 4607 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _renew_subs 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff40b2c50 con 0x7f0ff40585e0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 client.4607.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _renew_subs 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ff40b3210 con 0x7f0ff40585e0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 1 librados: init done 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.430+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff40b64c0 con 0x7f0ff40585e0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.431+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f79c4163930 con 0x7f79c40585e0 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.431+0000 7f799bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.431+0000 7f799bfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29cc003520 con 0x7f29dc0585e0 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f29cc003b90 con 0x7f29dc0585e0 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29cb7fe640 4 set_mon_vals no callback set 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.434+0000 7f29c9ffb640 10 monclient: dump: 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.435 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.435+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f29cc003d70 con 0x7f29dc0585e0 2026-02-25T15:01:21.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.435+0000 7f29e0c67640 10 monclient: get_auth_request con 0x7f29ac079fa0 auth_method 0 2026-02-25T15:01:21.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.435+0000 7f29c9ffb640 10 client.4601.objecter ms_handle_connect 0x7f29ac079fa0 2026-02-25T15:01:21.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2969802114 0 0) 0x7f47380b3f00 con 0x7f4738056090 2026-02-25T15:01:21.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47381fcb50 con 0x7f4738056090 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4728003060 con 0x7f4738056090 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f4725ffb640 10 monclient(hunting): dump: 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.438 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f29cc095d90 con 0x7f29dc0585e0 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f29c9ffb640 10 client.4601.objecter ms_dispatch2 0x7f29dc000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f29c9ffb640 3 client.4601.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f29c9ffb640 3 client.4601.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.436+0000 7f29c9ffb640 20 client.4601.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3240943670 0 0) 0x7f47381fcb50 con 0x7f4738056090 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 >> v1:10.20.193.68:6789/0 conn(0x7f4738159da0 legacy=0x7f47381fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 >> v1:10.20.193.21:6789/0 conn(0x7f4738165880 legacy=0x7f4738152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 1 monclient: found mon.b 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47381fd0f0 con 0x7f4738056090 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f4725ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f473fa01640 5 monclient: authenticate success, global_id 4597 2026-02-25T15:01:21.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f473fa01640 10 monclient: _renew_subs 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f473fa01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.437+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47381fd3d0 con 0x7f4738056090 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 client.4597.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 monclient: _renew_subs 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47381fe5c0 con 0x7f4738056090 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 1 librados: init done 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f29dc056070 con 0x7f29dc0585e0 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f29c9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f29c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.438+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47380b2d20 con 0x7f4738056090 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59d8003700 con 0x7f59e40585e0 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f59d8003ad0 con 0x7f59e40585e0 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 10 monclient: dump: 2026-02-25T15:01:21.443 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.444 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59e17fa640 4 set_mon_vals no callback set 2026-02-25T15:01:21.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.442+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f59d8003cb0 con 0x7f59e40585e0 2026-02-25T15:01:21.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.443+0000 7f59e27fc640 10 monclient: get_auth_request con 0x7f59b007a130 auth_method 0 2026-02-25T15:01:21.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.443+0000 7f59c37fe640 10 client.4587.objecter ms_handle_connect 0x7f59b007a130 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4728003700 con 0x7f4738056090 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4728003a50 con 0x7f4738056090 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f47277fe640 4 set_mon_vals no callback set 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.445+0000 7f4725ffb640 10 monclient: dump: 2026-02-25T15:01:21.446 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f59d8094790 con 0x7f59e40585e0 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 10 client.4587.objecter ms_dispatch2 0x7f59e4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 3 client.4587.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 3 client.4587.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 20 client.4587.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f472801cd90 con 0x7f4738056090 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f59d8003ad0 con 0x7f59e40585e0 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f59c37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.446+0000 7f473cf75640 10 monclient: get_auth_request con 0x7f470807a130 auth_method 0 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 10 client.4597.objecter ms_handle_connect 0x7f470807a130 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f4728094790 con 0x7f4738056090 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 10 client.4597.objecter ms_dispatch2 0x7f4738000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 3 client.4597.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 3 client.4597.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.447+0000 7f4725ffb640 20 client.4597.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.528+0000 7f76b9ffb640 1 -- 10.20.193.21:0/3919593989 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 213165853) 0x7f76bc05ef70 con 0x7f76cc058070 2026-02-25T15:01:21.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.528+0000 7f76b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-25T15:01:21.530 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.528+0000 7f76b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.530 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.530+0000 7f76d3513640 10 librados: watch_flush enter 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.530+0000 7f76d3513640 10 librados: watch_flush exit 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.530+0000 7f76d3513640 20 client.4571.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.530+0000 7f76d3513640 10 client.4571.objecter successfully canceled tick 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 >> v1:10.20.193.72:6800/2463505645 conn(0x7f769c079da0 legacy=0x7f769c09a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.533 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 10 monclient: shutdown 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 >> v1:10.20.193.68:6789/0 conn(0x7f76cc058070 legacy=0x7f76cc1467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 shutdown_connections 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 >> 10.20.193.21:0/3919593989 conn(0x7f76cc0b7780 msgr2=0x7f76cc162c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 shutdown_connections 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 -- 10.20.193.21:0/3919593989 wait complete. 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.531+0000 7f76d3513640 1 librados: shutdown 2026-02-25T15:01:21.534 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fe0003140 con 0x7f0ff40585e0 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0fe0003e00 con 0x7f0ff40585e0 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0ff1ffb640 4 set_mon_vals no callback set 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.533+0000 7f0fcffff640 10 monclient: dump: 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.535 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.536 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.536 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.536 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.536 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.536 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.534+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f0fe0003fe0 con 0x7f0ff40585e0 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.534+0000 7f0ff2ffd640 10 monclient: get_auth_request con 0x7f0fc4079e50 auth_method 0 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 10 client.4607.objecter ms_handle_connect 0x7f0fc4079e50 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f0fe0095d90 con 0x7f0ff40585e0 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 10 client.4607.objecter ms_dispatch2 0x7f0ff4000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 3 client.4607.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 3 client.4607.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.538 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.535+0000 7f0fcffff640 20 client.4607.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.538 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f0ff4163930 con 0x7f0ff40585e0 2026-02-25T15:01:21.538 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f0fcffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.538 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f0fcffff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f47380b2d20 con 0x7f4738056090 2026-02-25T15:01:21.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f4725ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.537+0000 7f4725ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.541 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.539+0000 7f79c9933640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:21.541 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.539+0000 7f79c9933640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:21.541 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.539+0000 7f79c9933640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.541 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.539+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f79c40b9530 con 0x7f79c40585e0 2026-02-25T15:01:21.542 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.541+0000 7f799bfff640 1 -- 10.20.193.21:0/1757156887 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 213165853) 0x7f79b805f800 con 0x7f79c40585e0 2026-02-25T15:01:21.542 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.541+0000 7f799bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-25T15:01:21.542 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.541+0000 7f799bfff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.543 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:21.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.2 2026-02-25T15:01:21.545 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.541+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c14003190 con 0x7f3c24056ea0 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3c14004a70 con 0x7f3c24056ea0 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c137fe640 4 set_mon_vals no callback set 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 10 monclient: dump: 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.546 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.542+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3c1401df50 con 0x7f3c24056ea0 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f3c28f25640 10 monclient: get_auth_request con 0x7f3bf4079e90 auth_method 0 2026-02-25T15:01:21.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f3c11ffb640 10 client.4590.objecter ms_handle_connect 0x7f3bf4079e90 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 10 librados: watch_flush enter 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 10 librados: watch_flush exit 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 20 client.4585.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 10 client.4585.objecter successfully canceled tick 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 >> v1:10.20.193.72:6800/2463505645 conn(0x7f7994079ff0 legacy=0x7f799409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 10 monclient: shutdown 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 >> v1:10.20.193.31:6789/0 conn(0x7f79c40585e0 legacy=0x7f79c4166290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.549 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 shutdown_connections 2026-02-25T15:01:21.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 >> 10.20.193.21:0/1757156887 conn(0x7f79c40b7990 msgr2=0x7f79c40b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 shutdown_connections 2026-02-25T15:01:21.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 -- 10.20.193.21:0/1757156887 wait complete. 2026-02-25T15:01:21.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.543+0000 7f79c9933640 1 librados: shutdown 2026-02-25T15:01:21.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.545+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 2791046787 0 0) 0x7f3c14095b50 con 0x7f3c24056ea0 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.545+0000 7f3c11ffb640 10 client.4590.objecter ms_dispatch2 0x7f3c24000b90 osd_map(29..29 src has 1..29) 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.545+0000 7f3c11ffb640 3 client.4590.objecter handle_osd_map got epochs [29,29] > 0 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.545+0000 7f3c11ffb640 3 client.4590.objecter handle_osd_map decoding full epoch 29 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.545+0000 7f3c11ffb640 20 client.4590.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.546+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f3c1405f4b0 con 0x7f3c24056ea0 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.546+0000 7f3c11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.546+0000 7f3c11ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:21.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.549+0000 7f29e36f3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:21.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.549+0000 7f29e36f3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:21.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.549+0000 7f29e36f3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.549+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f29dc0b9350 con 0x7f29dc0585e0 2026-02-25T15:01:21.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.551+0000 7f29c9ffb640 1 -- 10.20.193.21:0/769868539 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 213165853) 0x7f29cc05f6f0 con 0x7f29dc0585e0 2026-02-25T15:01:21.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.551+0000 7f29c9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-25T15:01:21.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.551+0000 7f29c9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.553 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:21.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.15 2026-02-25T15:01:21.555 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 10 librados: watch_flush enter 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 10 librados: watch_flush exit 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 20 client.4601.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 10 client.4601.objecter successfully canceled tick 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 >> v1:10.20.193.72:6800/2463505645 conn(0x7f29ac079fa0 legacy=0x7f29ac09a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 10 monclient: shutdown 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 >> v1:10.20.193.68:6789/0 conn(0x7f29dc0585e0 legacy=0x7f29dc1fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 shutdown_connections 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 >> 10.20.193.21:0/769868539 conn(0x7f29dc0b7990 msgr2=0x7f29dc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 shutdown_connections 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 -- 10.20.193.21:0/769868539 wait complete. 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.554+0000 7f29e36f3640 1 librados: shutdown 2026-02-25T15:01:21.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.556+0000 7f59e929f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:21.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.556+0000 7f59e929f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:21.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.556+0000 7f59e929f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.556+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f59e413b3f0 con 0x7f59e40585e0 2026-02-25T15:01:21.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.559+0000 7f59c37fe640 1 -- 10.20.193.21:0/3576880262 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1498640560) 0x7f59d805e0f0 con 0x7f59e40585e0 2026-02-25T15:01:21.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.559+0000 7f59c37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-25T15:01:21.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.559+0000 7f59c37fe640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.561 INFO:teuthology.orchestra.run.trial021.stdout:90194313221 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 10 librados: watch_flush enter 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 10 librados: watch_flush exit 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 20 client.4587.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 10 client.4587.objecter successfully canceled tick 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 >> v1:10.20.193.72:6800/2463505645 conn(0x7f59b007a130 legacy=0x7f59b009a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 10 monclient: shutdown 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 >> v1:10.20.193.21:6789/0 conn(0x7f59e40585e0 legacy=0x7f59e41faef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 shutdown_connections 2026-02-25T15:01:21.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.561+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 >> 10.20.193.21:0/3576880262 conn(0x7f59e40b7990 msgr2=0x7f59e4158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.562+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 shutdown_connections 2026-02-25T15:01:21.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.562+0000 7f59e929f640 1 -- 10.20.193.21:0/3576880262 wait complete. 2026-02-25T15:01:21.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.562+0000 7f59e929f640 1 librados: shutdown 2026-02-25T15:01:21.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.11 2026-02-25T15:01:21.566 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.8 2026-02-25T15:01:21.573 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.646+0000 7f473fa01640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:21.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.646+0000 7f473fa01640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:21.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.646+0000 7f473fa01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.646+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f4738056980 con 0x7f4738056090 2026-02-25T15:01:21.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.648+0000 7f4725ffb640 1 -- 10.20.193.21:0/2124290490 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 521551722) 0x7f472805e0f0 con 0x7f4738056090 2026-02-25T15:01:21.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.648+0000 7f4725ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-25T15:01:21.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.648+0000 7f4725ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.650 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:21.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.649+0000 7f0ff9d4d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:21.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.649+0000 7f0ff9d4d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:21.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.649+0000 7f0ff9d4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.649+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0ff40b94f0 con 0x7f0ff40585e0 2026-02-25T15:01:21.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 10 librados: watch_flush enter 2026-02-25T15:01:21.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 10 librados: watch_flush exit 2026-02-25T15:01:21.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 20 client.4597.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 10 client.4597.objecter successfully canceled tick 2026-02-25T15:01:21.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 >> v1:10.20.193.72:6800/2463505645 conn(0x7f470807a130 legacy=0x7f470809a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 10 monclient: shutdown 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 >> v1:10.20.193.31:6789/0 conn(0x7f4738056090 legacy=0x7f47380b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 shutdown_connections 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 >> 10.20.193.21:0/2124290490 conn(0x7f47380b78c0 msgr2=0x7f4738158760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 shutdown_connections 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 -- 10.20.193.21:0/2124290490 wait complete. 2026-02-25T15:01:21.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.650+0000 7f473fa01640 1 librados: shutdown 2026-02-25T15:01:21.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.654+0000 7f0fcffff640 1 -- 10.20.193.21:0/1110150301 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 521551722) 0x7f0fe005f6f0 con 0x7f0ff40585e0 2026-02-25T15:01:21.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.654+0000 7f0fcffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-25T15:01:21.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.654+0000 7f0fcffff640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.656 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 10 librados: watch_flush enter 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 10 librados: watch_flush exit 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 20 client.4607.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 10 client.4607.objecter successfully canceled tick 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 >> v1:10.20.193.72:6800/2463505645 conn(0x7f0fc4079e50 legacy=0x7f0fc409a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 10 monclient: shutdown 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.659 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 >> v1:10.20.193.68:6789/0 conn(0x7f0ff40585e0 legacy=0x7f0ff40b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 shutdown_connections 2026-02-25T15:01:21.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 >> 10.20.193.21:0/1110150301 conn(0x7f0ff40b7990 msgr2=0x7f0ff40b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 shutdown_connections 2026-02-25T15:01:21.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 -- 10.20.193.21:0/1110150301 wait complete. 2026-02-25T15:01:21.660 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.656+0000 7f0ff9d4d640 1 librados: shutdown 2026-02-25T15:01:21.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.657+0000 7f3c2b9b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:21.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.657+0000 7f3c2b9b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:21.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.657+0000 7f3c2b9b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:21.661 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.657+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f3c24135d10 con 0x7f3c24056ea0 2026-02-25T15:01:21.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.14 2026-02-25T15:01:21.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.660+0000 7f3c11ffb640 1 -- 10.20.193.21:0/3133469540 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 521551722) 0x7f3c1405edb0 con 0x7f3c24056ea0 2026-02-25T15:01:21.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.660+0000 7f3c11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-25T15:01:21.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.660+0000 7f3c11ffb640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:21.663 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:21.664 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.665 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 10 librados: watch_flush enter 2026-02-25T15:01:21.665 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 10 librados: watch_flush exit 2026-02-25T15:01:21.665 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 20 client.4590.objecter shutdown clearing up homeless session... 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 10 client.4590.objecter successfully canceled tick 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3bf4079e90 legacy=0x7f3bf409a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 10 monclient: shutdown 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 >> v1:10.20.193.21:6789/0 conn(0x7f3c24056ea0 legacy=0x7f3c24137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 shutdown_connections 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 >> 10.20.193.21:0/3133469540 conn(0x7f3c240b7470 msgr2=0x7f3c2415c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 shutdown_connections 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 -- 10.20.193.21:0/3133469540 wait complete. 2026-02-25T15:01:21.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.662+0000 7f3c2b9b1640 1 librados: shutdown 2026-02-25T15:01:21.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.5 2026-02-25T15:01:21.668 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.12 2026-02-25T15:01:21.673 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:21.818 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.885+0000 7fa55e667640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.885+0000 7fa55e667640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.885+0000 7fa55e667640 10 monclient: monmap: 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.886506+0000 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.886506+0000 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.886+0000 7fa55e667640 1 Processor -- start 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.886+0000 7fa55e667640 1 -- start start 2026-02-25T15:01:21.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.886+0000 7fa55e667640 10 monclient: init 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-b con 0x7fa5580b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-c con 0x7fa5580ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-a con 0x7fa5580585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa558163930 con 0x7fa5580585e0 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa558163bb0 con 0x7fa5580b9f80 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa558163e90 con 0x7fa5580ba350 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55e667640 10 monclient(hunting): authenticate will time out at 3025.479190s 2026-02-25T15:01:21.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55cbdd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fa5580585e0 0x7fa558166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46988/0 (socket says 10.20.193.21:46988) 2026-02-25T15:01:21.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.887+0000 7fa55cbdd640 1 -- 10.20.193.21:0/3541503539 learned_addr learned my addr 10.20.193.21:0/3541503539 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263824274 0 0) 0x7fa558163bb0 con 0x7fa5580b9f80 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): my global_id is 4600 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa53c003610 con 0x7fa5580b9f80 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888935625 0 0) 0x7fa54c002c90 con 0x7fa5580585e0 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): my global_id is 4602 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa558163bb0 con 0x7fa5580585e0 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983337317 0 0) 0x7fa558163e90 con 0x7fa5580ba350 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 10 monclient(hunting): my global_id is 4610 2026-02-25T15:01:21.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.889+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54c002c90 con 0x7fa5580ba350 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 498097195 0 0) 0x7fa53c003610 con 0x7fa5580b9f80 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 >> v1:10.20.193.68:6789/0 conn(0x7fa5580ba350 legacy=0x7fa558057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 >> v1:10.20.193.21:6789/0 conn(0x7fa5580585e0 legacy=0x7fa558166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 monclient: found mon.noname-b 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580573f0 con 0x7fa5580b9f80 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa544002df0 con 0x7fa5580b9f80 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa55e667640 5 monclient: authenticate success, global_id 4600 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa55e667640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa556ffd640 10 monclient: dump: 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.892 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.890+0000 7fa55e667640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.893 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa544002fc0 con 0x7fa5580b9f80 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 1 -- 10.20.193.21:0/3541503539 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa544003400 con 0x7fa5580b9f80 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa556ffd640 10 monclient: dump: 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.893 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa55e667640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.891+0000 7fa55e667640 4 set_mon_vals no callback set 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 10 monclient: shutdown 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 -- 10.20.193.21:0/3541503539 >> v1:10.20.193.31:6789/0 conn(0x7fa5580b9f80 legacy=0x7fa558163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 -- 10.20.193.21:0/3541503539 shutdown_connections 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 -- 10.20.193.21:0/3541503539 >> 10.20.193.21:0/3541503539 conn(0x7fa5580b7990 msgr2=0x7fa5580b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 -- 10.20.193.21:0/3541503539 shutdown_connections 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 -- 10.20.193.21:0/3541503539 wait complete. 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 10 monclient: monmap: 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.894 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 librados: starting msgr at 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 1 librados: starting objecter 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.892+0000 7fa55e667640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 Processor -- start 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 -- start start 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 librados: setting wanted keys 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 librados: calling monclient init 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient: init 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-c con 0x7fa5580585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-b con 0x7fa5580b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient(hunting): picked mon.noname-a con 0x7fa5580ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580b4ea0 con 0x7fa5580ba350 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580b23b0 con 0x7fa5580b9f80 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5580b2690 con 0x7fa5580585e0 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55e667640 10 monclient(hunting): authenticate will time out at 3025.485501s 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55cbdd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fa5580ba350 0x7fa5581fe480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:46994/0 (socket says 10.20.193.21:46994) 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa55cbdd640 1 -- 10.20.193.21:0/343916901 learned_addr learned my addr 10.20.193.21:0/343916901 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa554ff9640 10 client.?.objecter ms_handle_connect 0x7fa5580ba350 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa554ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa554ff9640 10 client.?.objecter ms_handle_connect 0x7fa5580b9f80 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.893+0000 7fa554ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 client.?.objecter ms_handle_connect 0x7fa5580585e0 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521485202 0 0) 0x7fa5580b23b0 con 0x7fa5580b9f80 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): my global_id is 4603 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa528003610 con 0x7fa5580b9f80 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275205084 0 0) 0x7fa5580b4ea0 con 0x7fa5580ba350 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 10 monclient(hunting): my global_id is 4605 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.894+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5580b23b0 con 0x7fa5580ba350 2026-02-25T15:01:21.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004902810 0 0) 0x7fa5580b2690 con 0x7fa5580585e0 2026-02-25T15:01:21.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 10 monclient(hunting): my global_id is 4613 2026-02-25T15:01:21.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.895+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5580b4ea0 con 0x7fa5580585e0 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3916684719 0 0) 0x7fa528003610 con 0x7fa5580b9f80 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5580b2690 con 0x7fa5580b9f80 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa548002fb0 con 0x7fa5580b9f80 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.898 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3756650132 0 0) 0x7fa5580b23b0 con 0x7fa5580ba350 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa528003610 con 0x7fa5580ba350 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa54c0035d0 con 0x7fa5580ba350 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 223403120 0 0) 0x7fa5580b4ea0 con 0x7fa5580585e0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5580b23b0 con 0x7fa5580585e0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa544003310 con 0x7fa5580585e0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.897+0000 7fa554ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 680832728 0 0) 0x7fa5580b2690 con 0x7fa5580b9f80 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 >> v1:10.20.193.68:6789/0 conn(0x7fa5580585e0 legacy=0x7fa5580b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 >> v1:10.20.193.21:6789/0 conn(0x7fa5580ba350 legacy=0x7fa5581fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 1 monclient: found mon.b 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580b2970 con 0x7fa5580b9f80 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa554ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 5 monclient: authenticate success, global_id 4603 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _renew_subs 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5580b2c50 con 0x7fa5580b9f80 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 client.4603.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _renew_subs 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5580b3210 con 0x7fa5580b9f80 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 1 librados: init done 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:21.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.899+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5580b64c0 con 0x7fa5580b9f80 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa548003700 con 0x7fa5580b9f80 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa5480038b0 con 0x7fa5580b9f80 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa554ff9640 10 monclient: dump: 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.906+0000 7fa5567fc640 4 set_mon_vals no callback set 2026-02-25T15:01:21.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.907+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fa54801cdd0 con 0x7fa5580b9f80 2026-02-25T15:01:21.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.908+0000 7fa557fff640 10 monclient: get_auth_request con 0x7fa52807a090 auth_method 0 2026-02-25T15:01:21.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.908+0000 7fa554ff9640 10 client.4603.objecter ms_handle_connect 0x7fa52807a090 2026-02-25T15:01:21.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.909+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7fa5480947d0 con 0x7fa5580b9f80 2026-02-25T15:01:21.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.909+0000 7fa554ff9640 10 client.4603.objecter ms_dispatch2 0x7fa558000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:21.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.909+0000 7fa554ff9640 3 client.4603.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:21.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.909+0000 7fa554ff9640 3 client.4603.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:21.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.909+0000 7fa554ff9640 20 client.4603.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.933 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 10 monclient: get_monmap_and_config 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 10 monclient: monmap: 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:21.960897+0000 2026-02-25T15:01:21.961 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:21.960897+0000 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 1 Processor -- start 2026-02-25T15:01:21.962 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 1 -- start start 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.960+0000 7fa1fa40c640 10 monclient: init 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-c con 0x7fa1f40b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-a con 0x7fa1f40ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-b con 0x7fa1f40585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f4163930 con 0x7fa1f40ba350 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f4163bb0 con 0x7fa1f40585e0 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f4163e90 con 0x7fa1f40b9f80 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1fa40c640 10 monclient(hunting): authenticate will time out at 3025.553405s 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1f3fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa1f40b9f80 0x7fa1f4163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54568/0 (socket says 10.20.193.21:54568) 2026-02-25T15:01:21.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.961+0000 7fa1f3fff640 1 -- 10.20.193.21:0/582590977 learned_addr learned my addr 10.20.193.21:0/582590977 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166021245 0 0) 0x7fa1f4163e90 con 0x7fa1f40b9f80 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): my global_id is 4616 2026-02-25T15:01:21.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1d8003610 con 0x7fa1f40b9f80 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493304065 0 0) 0x7fa1e4002910 con 0x7fa1f40ba350 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 10 monclient(hunting): my global_id is 4608 2026-02-25T15:01:21.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.963+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f4163e90 con 0x7fa1f40ba350 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3042572176 0 0) 0x7fa1d8003610 con 0x7fa1f40b9f80 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 >> v1:10.20.193.31:6789/0 conn(0x7fa1f40585e0 legacy=0x7fa1f4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 >> v1:10.20.193.21:6789/0 conn(0x7fa1f40ba350 legacy=0x7fa1f4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 monclient: found mon.noname-c 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f40573f0 con 0x7fa1f40b9f80 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1e0002df0 con 0x7fa1f40b9f80 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1f2ffd640 10 monclient: dump: 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.966 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1fa40c640 5 monclient: authenticate success, global_id 4616 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.964+0000 7fa1fa40c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1e0003000 con 0x7fa1f40b9f80 2026-02-25T15:01:21.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 1 -- 10.20.193.21:0/582590977 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1e0003440 con 0x7fa1f40b9f80 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1f2ffd640 10 monclient: dump: 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1fa40c640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1fa40c640 4 set_mon_vals no callback set 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1fa40c640 10 monclient: shutdown 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1fa40c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.965+0000 7fa1fa40c640 1 -- 10.20.193.21:0/582590977 >> v1:10.20.193.68:6789/0 conn(0x7fa1f40b9f80 legacy=0x7fa1f4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 -- 10.20.193.21:0/582590977 shutdown_connections 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 -- 10.20.193.21:0/582590977 >> 10.20.193.21:0/582590977 conn(0x7fa1f40b7990 msgr2=0x7fa1f40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 -- 10.20.193.21:0/582590977 shutdown_connections 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 -- 10.20.193.21:0/582590977 wait complete. 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 10 monclient: build_initial_monmap 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 10 monclient: monmap: 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:21.968 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:21.969 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 librados: starting msgr at 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 librados: starting objecter 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 Processor -- start 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 -- start start 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 librados: setting wanted keys 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 1 librados: calling monclient init 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.966+0000 7fa1fa40c640 10 monclient: init 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-b con 0x7fa1f40585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-a con 0x7fa1f40b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient(hunting): picked mon.noname-c con 0x7fa1f40ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f41622f0 con 0x7fa1f40b9f80 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f41625b0 con 0x7fa1f40585e0 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f4162890 con 0x7fa1f40ba350 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1fa40c640 10 monclient(hunting): authenticate will time out at 3025.559476s 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1f8982640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa1f40ba350 0x7fa1f41fb280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54578/0 (socket says 10.20.193.21:54578) 2026-02-25T15:01:21.970 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.967+0000 7fa1f8982640 1 -- 10.20.193.21:0/2326919429 learned_addr learned my addr 10.20.193.21:0/2326919429 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 client.?.objecter ms_handle_connect 0x7fa1f40ba350 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 client.?.objecter ms_handle_connect 0x7fa1f40b9f80 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695835884 0 0) 0x7fa1f4162890 con 0x7fa1f40ba350 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 10 monclient(hunting): my global_id is 4619 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.968+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1c4003610 con 0x7fa1f40ba350 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481982368 0 0) 0x7fa1f41622f0 con 0x7fa1f40b9f80 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 10 monclient(hunting): my global_id is 4611 2026-02-25T15:01:21.971 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.969+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f4162890 con 0x7fa1f40b9f80 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2289105003 0 0) 0x7fa1c4003610 con 0x7fa1f40ba350 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1f41622f0 con 0x7fa1f40ba350 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1e80032d0 con 0x7fa1f40ba350 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.972 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 224952316 0 0) 0x7fa1f4162890 con 0x7fa1f40b9f80 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1c4003610 con 0x7fa1f40b9f80 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1e40031c0 con 0x7fa1f40b9f80 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.971+0000 7fa1f0ff9640 10 monclient(hunting): dump: 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.973 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1756624458 0 0) 0x7fa1f41622f0 con 0x7fa1f40ba350 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 >> v1:10.20.193.31:6789/0 conn(0x7fa1f40585e0 legacy=0x7fa1f41fc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 >> v1:10.20.193.21:6789/0 conn(0x7fa1f40b9f80 legacy=0x7fa1f41656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 1 monclient: found mon.c 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f4162b70 con 0x7fa1f40ba350 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 5 monclient: authenticate success, global_id 4619 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 10 monclient: _renew_subs 2026-02-25T15:01:21.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f4162e50 con 0x7fa1f40ba350 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 10 client.4619.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 10 monclient: _renew_subs 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1f4163650 con 0x7fa1f40ba350 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.972+0000 7fa1fa40c640 1 librados: init done 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.973+0000 7fa1fa40c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.973+0000 7fa1fa40c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.973+0000 7fa1fa40c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:21.975 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.973+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f41573e0 con 0x7fa1f40ba350 2026-02-25T15:01:21.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1e8003950 con 0x7fa1f40ba350 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa1e8004ee0 con 0x7fa1f40ba350 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f0ff9640 10 monclient: dump: 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.980+0000 7fa1f27fc640 4 set_mon_vals no callback set 2026-02-25T15:01:21.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.981+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fa1e801e3c0 con 0x7fa1f40ba350 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.981+0000 7fa1f3fff640 10 monclient: get_auth_request con 0x7fa1c4079ef0 auth_method 0 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 10 client.4619.objecter ms_handle_connect 0x7fa1c4079ef0 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7fa1e8095f10 con 0x7fa1f40ba350 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 10 client.4619.objecter ms_dispatch2 0x7fa1f4000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 3 client.4619.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 3 client.4619.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:21.983 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.982+0000 7fa1f0ff9640 20 client.4619.objecter dump_active .. 0 homeless 2026-02-25T15:01:21.993 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T15:01:21.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.996+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fa54805e130 con 0x7fa5580b9f80 2026-02-25T15:01:21.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.996+0000 7fa554ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:21.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:21.996+0000 7fa554ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 10 monclient: monmap: 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.002015+0000 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.002015+0000 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.002 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 1 Processor -- start 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 1 -- start start 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.001+0000 7f419c513640 10 monclient: init 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient(hunting): picked mon.noname-a con 0x7f41940b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient(hunting): picked mon.noname-b con 0x7f41940ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient(hunting): picked mon.noname-c con 0x7f41940585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4194163930 con 0x7f41940b9f80 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4194163bb0 con 0x7f41940ba350 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4194163e90 con 0x7f41940585e0 2026-02-25T15:01:22.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419c513640 10 monclient(hunting): authenticate will time out at 3025.594484s 2026-02-25T15:01:22.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419a288640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f41940b9f80 0x7f4194163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47032/0 (socket says 10.20.193.21:47032) 2026-02-25T15:01:22.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.002+0000 7f419a288640 1 -- 10.20.193.21:0/3906881801 learned_addr learned my addr 10.20.193.21:0/3906881801 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631393629 0 0) 0x7f4194163bb0 con 0x7f41940ba350 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): my global_id is 4606 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f417c003610 con 0x7f41940ba350 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554280601 0 0) 0x7f4184002910 con 0x7f41940b9f80 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 10 monclient(hunting): my global_id is 4614 2026-02-25T15:01:22.005 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.004+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4194163bb0 con 0x7f41940b9f80 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1925494355 0 0) 0x7f417c003610 con 0x7f41940ba350 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 >> v1:10.20.193.68:6789/0 conn(0x7f41940585e0 legacy=0x7f4194166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 >> v1:10.20.193.21:6789/0 conn(0x7f41940b9f80 legacy=0x7f4194163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 monclient: found mon.noname-b 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41940573f0 con 0x7f41940ba350 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4188002df0 con 0x7f41940ba350 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f4199286640 10 monclient: dump: 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f419c513640 5 monclient: authenticate success, global_id 4606 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.005+0000 7f419c513640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4188003000 con 0x7f41940ba350 2026-02-25T15:01:22.007 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 1 -- 10.20.193.21:0/3906881801 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4188003440 con 0x7f41940ba350 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f4199286640 10 monclient: dump: 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f419c513640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.006+0000 7f419c513640 4 set_mon_vals no callback set 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 10 monclient: shutdown 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- 10.20.193.21:0/3906881801 >> v1:10.20.193.31:6789/0 conn(0x7f41940ba350 legacy=0x7f4194057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- 10.20.193.21:0/3906881801 shutdown_connections 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- 10.20.193.21:0/3906881801 >> 10.20.193.21:0/3906881801 conn(0x7f41940b7990 msgr2=0x7f41940b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- 10.20.193.21:0/3906881801 shutdown_connections 2026-02-25T15:01:22.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- 10.20.193.21:0/3906881801 wait complete. 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 10 monclient: monmap: 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 librados: starting msgr at 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 librados: starting objecter 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 Processor -- start 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 -- start start 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 librados: setting wanted keys 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 1 librados: calling monclient init 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.007+0000 7f419c513640 10 monclient: init 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient(hunting): picked mon.noname-b con 0x7f41940585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient(hunting): picked mon.noname-c con 0x7f41940b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient(hunting): picked mon.noname-a con 0x7f41940ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41940aefa0 con 0x7f41940ba350 2026-02-25T15:01:22.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41941fb8b0 con 0x7f41940585e0 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41941fbb90 con 0x7f41940b9f80 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419c513640 10 monclient(hunting): authenticate will time out at 3025.600287s 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419aa89640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f41940ba350 0x7f4194165910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47042/0 (socket says 10.20.193.21:47042) 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f419aa89640 1 -- 10.20.193.21:0/1478406899 learned_addr learned my addr 10.20.193.21:0/1478406899 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f417affd640 10 client.?.objecter ms_handle_connect 0x7f41940ba350 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.008+0000 7f417affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 client.?.objecter ms_handle_connect 0x7f41940585e0 2026-02-25T15:01:22.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203751991 0 0) 0x7f41940aefa0 con 0x7f41940ba350 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 10 monclient(hunting): my global_id is 4617 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.009+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4164003610 con 0x7f41940ba350 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049635827 0 0) 0x7f41941fb8b0 con 0x7f41940585e0 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 10 monclient(hunting): my global_id is 4609 2026-02-25T15:01:22.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.010+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41940aefa0 con 0x7f41940585e0 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3337879960 0 0) 0x7f4164003610 con 0x7f41940ba350 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41941fb8b0 con 0x7f41940ba350 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f41900032d0 con 0x7f41940ba350 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.012+0000 7f417affd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891176772 0 0) 0x7f41940aefa0 con 0x7f41940585e0 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4164003610 con 0x7f41940585e0 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4184003200 con 0x7f41940585e0 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.013+0000 7f417affd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.014 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2477723433 0 0) 0x7f41941fb8b0 con 0x7f41940ba350 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 >> v1:10.20.193.68:6789/0 conn(0x7f41940b9f80 legacy=0x7f41940ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 >> v1:10.20.193.31:6789/0 conn(0x7f41940585e0 legacy=0x7f4194164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 1 monclient: found mon.a 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41941fbe70 con 0x7f41940ba350 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f417affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 5 monclient: authenticate success, global_id 4617 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _renew_subs 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4194164740 con 0x7f41940ba350 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 client.4617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _renew_subs 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41940b05c0 con 0x7f41940ba350 2026-02-25T15:01:22.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 1 librados: init done 2026-02-25T15:01:22.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.014+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41940b08a0 con 0x7f41940ba350 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.058+0000 7f3d80b83640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.058+0000 7f3d80b83640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.058+0000 7f3d80b83640 10 monclient: monmap: 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.059575+0000 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.059575+0000 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.060 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.060 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 1 Processor -- start 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 1 -- start start 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient: init 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-b con 0x7f3d7c161430 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-a con 0x7f3d7c161800 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-c con 0x7f3d7c16ad30 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0b1800 con 0x7f3d7c161800 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0b1ae0 con 0x7f3d7c161430 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0b1dc0 con 0x7f3d7c16ad30 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.059+0000 7f3d80b83640 10 monclient(hunting): authenticate will time out at 3025.651881s 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.060+0000 7f3d7a575640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3d7c161430 0x7f3d7c0b0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47664/0 (socket says 10.20.193.21:47664) 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.060+0000 7f3d7a575640 1 -- 10.20.193.21:0/3718533759 learned_addr learned my addr 10.20.193.21:0/3718533759 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839977148 0 0) 0x7f3d7c0b1ae0 con 0x7f3d7c161430 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 10 monclient(hunting): my global_id is 4612 2026-02-25T15:01:22.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.061+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d68003610 con 0x7f3d7c161430 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4058632568 0 0) 0x7f3d68003610 con 0x7f3d7c161430 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 >> v1:10.20.193.68:6789/0 conn(0x7f3d7c16ad30 legacy=0x7f3d7c16b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 >> v1:10.20.193.21:6789/0 conn(0x7f3d7c161800 legacy=0x7f3d7c168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 monclient: found mon.noname-b 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c0b20a0 con 0x7f3d7c161430 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d70002df0 con 0x7f3d7c161430 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d79573640 10 monclient: dump: 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.064 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d80b83640 5 monclient: authenticate success, global_id 4612 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.063+0000 7f3d80b83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d70003000 con 0x7f3d7c161430 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 1 -- 10.20.193.21:0/3718533759 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d70003440 con 0x7f3d7c161430 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d79573640 10 monclient: dump: 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.065 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 4 set_mon_vals no callback set 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 10 monclient: shutdown 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 1 -- 10.20.193.21:0/3718533759 >> v1:10.20.193.31:6789/0 conn(0x7f3d7c161430 legacy=0x7f3d7c0b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 1 -- 10.20.193.21:0/3718533759 shutdown_connections 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 1 -- 10.20.193.21:0/3718533759 >> 10.20.193.21:0/3718533759 conn(0x7f3d7c0b2ef0 msgr2=0x7f3d7c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 1 -- 10.20.193.21:0/3718533759 shutdown_connections 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 1 -- 10.20.193.21:0/3718533759 wait complete. 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.064+0000 7f3d80b83640 10 monclient: monmap: 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.066 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 librados: starting msgr at 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 librados: starting objecter 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 Processor -- start 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 -- start start 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 librados: setting wanted keys 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 librados: calling monclient init 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient: init 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-c con 0x7f3d7c161430 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-b con 0x7f3d7c161800 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient(hunting): picked mon.noname-a con 0x7f3d7c16ad30 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0a3740 con 0x7f3d7c16ad30 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c0a3a20 con 0x7f3d7c161800 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d7c15f490 con 0x7f3d7c161430 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.065+0000 7f3d80b83640 10 monclient(hunting): authenticate will time out at 3025.657883s 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7f3d79d74640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f3d7c161800 0x7f3d7c0a57f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47674/0 (socket says 10.20.193.21:47674) 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7f3d79d74640 1 -- 10.20.193.21:0/3023694207 learned_addr learned my addr 10.20.193.21:0/3023694207 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fa1e805f870 con 0x7fa1f40ba350 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7fa1f0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7fa1f0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7f3d62ffd640 10 client.?.objecter ms_handle_connect 0x7f3d7c161800 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.066+0000 7f3d62ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465462567 0 0) 0x7f3d7c0a3a20 con 0x7f3d7c161800 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 10 monclient(hunting): my global_id is 4615 2026-02-25T15:01:22.068 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.067+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d48003610 con 0x7f3d7c161800 2026-02-25T15:01:22.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.068+0000 7f3d62ffd640 10 client.?.objecter ms_handle_connect 0x7f3d7c161430 2026-02-25T15:01:22.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.068+0000 7f3d62ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 818428262 0 0) 0x7f3d48003610 con 0x7f3d7c161800 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d7c0a3a20 con 0x7f3d7c161800 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d64002fd0 con 0x7f3d7c161800 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.069+0000 7f3d62ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32884561 0 0) 0x7f3d7c15f490 con 0x7f3d7c161430 2026-02-25T15:01:22.071 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 10 monclient(hunting): my global_id is 4622 2026-02-25T15:01:22.072 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.070+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d48003610 con 0x7f3d7c161430 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3670982407 0 0) 0x7f3d7c0a3a20 con 0x7f3d7c161800 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 >> v1:10.20.193.68:6789/0 conn(0x7f3d7c161430 legacy=0x7f3d7c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 >> v1:10.20.193.21:6789/0 conn(0x7f3d7c16ad30 legacy=0x7f3d7c15d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 1 monclient: found mon.b 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c15f770 con 0x7f3d7c161800 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.075 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 5 monclient: authenticate success, global_id 4615 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 10 monclient: _renew_subs 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c15fa50 con 0x7f3d7c161800 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 10 client.4615.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 10 monclient: _renew_subs 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d7c0a3d00 con 0x7f3d7c161800 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.072+0000 7f3d80b83640 1 librados: init done 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.073+0000 7f3d80b83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.073+0000 7f3d80b83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.073+0000 7f3d80b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.076 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.073+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c168cb0 con 0x7f3d7c161800 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d640049f0 con 0x7f3d7c161800 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3d64004ba0 con 0x7f3d7c161800 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d78d72640 4 set_mon_vals no callback set 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.078+0000 7f3d62ffd640 10 monclient: dump: 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.080 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3d6401e080 con 0x7f3d7c161800 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f3d64095cb0 con 0x7f3d7c161800 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 10 client.4615.objecter ms_dispatch2 0x7f3d7c000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 3 client.4615.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 3 client.4615.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d7a575640 10 monclient: get_auth_request con 0x7f3d48079fa0 auth_method 0 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.081+0000 7f3d62ffd640 20 client.4615.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.082+0000 7f3d62ffd640 10 client.4615.objecter ms_handle_connect 0x7f3d48079fa0 2026-02-25T15:01:22.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7fa55e667640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:22.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7fa55e667640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:22.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7fa55e667640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa5580b94f0 con 0x7fa5580b9f80 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4190003950 con 0x7f41940ba350 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4190004ee0 con 0x7f41940ba350 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f417affd640 10 monclient: dump: 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.107 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.105+0000 7f4198a85640 4 set_mon_vals no callback set 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.106+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f419001e3c0 con 0x7f41940ba350 2026-02-25T15:01:22.108 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.106+0000 7f419a288640 10 monclient: get_auth_request con 0x7f4164079ef0 auth_method 0 2026-02-25T15:01:22.109 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.107+0000 7f417affd640 10 client.4617.objecter ms_handle_connect 0x7f4164079ef0 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f4190095f10 con 0x7f41940ba350 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 10 client.4617.objecter ms_dispatch2 0x7f4194000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 3 client.4617.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 3 client.4617.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 20 client.4617.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f41940b08a0 con 0x7f41940ba350 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.109+0000 7f417affd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.127+0000 7fb7c30e8640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.127+0000 7fb7c30e8640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.127+0000 7fb7c30e8640 10 monclient: monmap: 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.128177+0000 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.128177+0000 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.129 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.127+0000 7fb7c30e8640 1 Processor -- start 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.127+0000 7fb7c30e8640 1 -- start start 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient: init 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-b con 0x7fb7bc15d0c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-c con 0x7fb7bc0b0ca0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-a con 0x7fb7bc0b28b0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0b8540 con 0x7fb7bc0b28b0 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0b5da0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.131 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0b6080 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c30e8640 10 monclient(hunting): authenticate will time out at 3025.720547s 2026-02-25T15:01:22.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c165e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fb7bc0b28b0 0x7fb7bc0b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47060/0 (socket says 10.20.193.21:47060) 2026-02-25T15:01:22.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7c165e640 1 -- 10.20.193.21:0/3391577509 learned_addr learned my addr 10.20.193.21:0/3391577509 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.128+0000 7fb7b3fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fb7bc0b0ca0 0x7fb7bc0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54606/0 (socket says 10.20.193.21:54606) 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399795646 0 0) 0x7fb7bc0b6080 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): my global_id is 4625 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7a8003610 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400688157 0 0) 0x7fb7bc0b8540 con 0x7fb7bc0b28b0 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 10 monclient(hunting): my global_id is 4620 2026-02-25T15:01:22.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.130+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7bc0b6080 con 0x7fb7bc0b28b0 2026-02-25T15:01:22.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3994170876 0 0) 0x7fb7a8003610 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 >> v1:10.20.193.31:6789/0 conn(0x7fb7bc15d0c0 legacy=0x7fb7bc0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 >> v1:10.20.193.21:6789/0 conn(0x7fb7bc0b28b0 legacy=0x7fb7bc0b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 1 monclient: found mon.noname-c 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.131+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc163e10 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb7a4002df0 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:22.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: dump: 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7c30e8640 5 monclient: authenticate success, global_id 4625 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7c30e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7a4003000 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 1 -- 10.20.193.21:0/3391577509 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb7a4003440 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7b37fe640 10 monclient: dump: 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.139 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7c30e8640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.132+0000 7fb7c30e8640 4 set_mon_vals no callback set 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 10 monclient: shutdown 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- 10.20.193.21:0/3391577509 >> v1:10.20.193.68:6789/0 conn(0x7fb7bc0b0ca0 legacy=0x7fb7bc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- 10.20.193.21:0/3391577509 shutdown_connections 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- 10.20.193.21:0/3391577509 >> 10.20.193.21:0/3391577509 conn(0x7fb7bc0b5290 msgr2=0x7fb7bc0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- 10.20.193.21:0/3391577509 shutdown_connections 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- 10.20.193.21:0/3391577509 wait complete. 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 10 monclient: monmap: 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.140 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 librados: starting msgr at 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 librados: starting objecter 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 Processor -- start 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 -- start start 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 librados: setting wanted keys 2026-02-25T15:01:22.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 1 librados: calling monclient init 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.133+0000 7fb7c30e8640 10 monclient: init 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-a con 0x7fb7bc0b0ca0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-b con 0x7fb7bc0b28b0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient(hunting): picked mon.noname-c con 0x7fb7bc15d0c0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc165da0 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0b3a10 con 0x7fb7bc0b28b0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc164310 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c30e8640 10 monclient(hunting): authenticate will time out at 3025.726434s 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c165e640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fb7bc15d0c0 0x7fb7bc1fb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54610/0 (socket says 10.20.193.21:54610) 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7c165e640 1 -- 10.20.193.21:0/1172460884 learned_addr learned my addr 10.20.193.21:0/1172460884 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7b17fa640 10 client.?.objecter ms_handle_connect 0x7fb7bc0b0ca0 2026-02-25T15:01:22.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.134+0000 7fb7b17fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 client.?.objecter ms_handle_connect 0x7fb7bc15d0c0 2026-02-25T15:01:22.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758836269 0 0) 0x7fb7bc164310 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 10 monclient(hunting): my global_id is 4628 2026-02-25T15:01:22.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.135+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78c003610 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89352443 0 0) 0x7fb7bc165da0 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 10 monclient(hunting): my global_id is 4623 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.136+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7bc164310 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2995327790 0 0) 0x7fb78c003610 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7bc165da0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb7b8003430 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): dump: 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.146 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3242892906 0 0) 0x7fb7bc164310 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb78c003610 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb7ac002ed0 con 0x7fb7bc0b0ca0 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.138+0000 7fb7b17fa640 10 monclient(hunting): dump: 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2915940561 0 0) 0x7fb7bc165da0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 >> v1:10.20.193.31:6789/0 conn(0x7fb7bc0b28b0 legacy=0x7fb7bc0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 >> v1:10.20.193.21:6789/0 conn(0x7fb7bc0b0ca0 legacy=0x7fb7bc165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 1 monclient: found mon.c 2026-02-25T15:01:22.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc1645f0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 5 monclient: authenticate success, global_id 4628 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 10 monclient: _renew_subs 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc1648d0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 10 client.4628.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 10 monclient: _renew_subs 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7bc164e90 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.139+0000 7fb7c30e8640 1 librados: init done 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.140+0000 7fb7c30e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.140+0000 7fb7c30e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.140+0000 7fb7c30e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.140+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc163470 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7b8004c50 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb7b8004fa0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b2ffd640 4 set_mon_vals no callback set 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.147+0000 7fb7b17fa640 10 monclient: dump: 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.148+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fb7b801e480 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.148+0000 7fb7c0e5d640 10 monclient: get_auth_request con 0x7fb78c079ee0 auth_method 0 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7fb7b8095fe0 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 10 client.4628.objecter ms_dispatch2 0x7fb7bc000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 3 client.4628.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 3 client.4628.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 20 client.4628.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.149+0000 7fb7b17fa640 10 client.4628.objecter ms_handle_connect 0x7fb78c079ee0 2026-02-25T15:01:22.170 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T15:01:22.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.171+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f3d6405f610 con 0x7f3d7c161800 2026-02-25T15:01:22.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.171+0000 7f3d62ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.171+0000 7f3d62ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.175+0000 7fa554ff9640 1 -- 10.20.193.21:0/343916901 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1257367751) 0x7fa54805da30 con 0x7fa5580b9f80 2026-02-25T15:01:22.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.175+0000 7fa554ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-25T15:01:22.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.175+0000 7fa554ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.177 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:22.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.176+0000 7fa1fa40c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:22.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.176+0000 7fa1fa40c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:22.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.176+0000 7fa1fa40c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.176+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa1f40b95f0 con 0x7fa1f40ba350 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 10 librados: watch_flush enter 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 10 librados: watch_flush exit 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 20 client.4603.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 10 client.4603.objecter successfully canceled tick 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 >> v1:10.20.193.72:6800/2463505645 conn(0x7fa52807a090 legacy=0x7fa52809a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 10 monclient: shutdown 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 >> v1:10.20.193.31:6789/0 conn(0x7fa5580b9f80 legacy=0x7fa5581fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 shutdown_connections 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 >> 10.20.193.21:0/343916901 conn(0x7fa5580b7990 msgr2=0x7fa5580b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 shutdown_connections 2026-02-25T15:01:22.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 -- 10.20.193.21:0/343916901 wait complete. 2026-02-25T15:01:22.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.178+0000 7fa55e667640 1 librados: shutdown 2026-02-25T15:01:22.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.1 2026-02-25T15:01:22.188 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.218 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.216+0000 7f419c513640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:22.218 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.216+0000 7f419c513640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:22.218 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.216+0000 7f419c513640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.218 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.216+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4194058140 con 0x7f41940ba350 2026-02-25T15:01:22.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.220+0000 7f417affd640 1 -- 10.20.193.21:0/1478406899 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1257367751) 0x7f419005f870 con 0x7f41940ba350 2026-02-25T15:01:22.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.220+0000 7f417affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-25T15:01:22.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.220+0000 7f417affd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.221 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 10 librados: watch_flush enter 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 10 librados: watch_flush exit 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 20 client.4617.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 10 client.4617.objecter successfully canceled tick 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 >> v1:10.20.193.72:6800/2463505645 conn(0x7f4164079ef0 legacy=0x7f416409a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 10 monclient: shutdown 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 >> v1:10.20.193.21:6789/0 conn(0x7f41940ba350 legacy=0x7f4194165910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 shutdown_connections 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 >> 10.20.193.21:0/1478406899 conn(0x7f41940b7990 msgr2=0x7f419415acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 shutdown_connections 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 -- 10.20.193.21:0/1478406899 wait complete. 2026-02-25T15:01:22.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.222+0000 7f419c513640 1 librados: shutdown 2026-02-25T15:01:22.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.9 2026-02-25T15:01:22.232 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.237+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fb7b805f940 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.237+0000 7fb7b17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.238 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.237+0000 7fb7b17fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.238+0000 7f7a685bb640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.238+0000 7f7a685bb640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.238+0000 7f7a685bb640 10 monclient: monmap: 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.239 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.239244+0000 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.239244+0000 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 1 Processor -- start 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 1 -- start start 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient: init 2026-02-25T15:01:22.240 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-c con 0x7f7a6015e1b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-b con 0x7f7a6015e580 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-a con 0x7f7a60083dc0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a60165270 con 0x7f7a60083dc0 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6005e1e0 con 0x7f7a6015e580 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a60161c60 con 0x7f7a6015e1b0 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a685bb640 10 monclient(hunting): authenticate will time out at 3025.831596s 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a66b31640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f7a60083dc0 0x7f7a60164b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47078/0 (socket says 10.20.193.21:47078) 2026-02-25T15:01:22.241 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.239+0000 7f7a66b31640 1 -- 10.20.193.21:0/1388601296 learned_addr learned my addr 10.20.193.21:0/1388601296 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967465898 0 0) 0x7f7a60165270 con 0x7f7a60083dc0 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 10 monclient(hunting): my global_id is 4626 2026-02-25T15:01:22.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.242+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a48003610 con 0x7f7a60083dc0 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491903218 0 0) 0x7f7a6005e1e0 con 0x7f7a6015e580 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 10 monclient(hunting): my global_id is 4618 2026-02-25T15:01:22.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.243+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a60165270 con 0x7f7a6015e580 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370557240 0 0) 0x7f7a48003610 con 0x7f7a60083dc0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 >> v1:10.20.193.68:6789/0 conn(0x7f7a6015e1b0 legacy=0x7f7a600b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 >> v1:10.20.193.31:6789/0 conn(0x7f7a6015e580 legacy=0x7f7a60164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 monclient: found mon.noname-a 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a600b3450 con 0x7f7a60083dc0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a5c003170 con 0x7f7a60083dc0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: dump: 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.245 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a685bb640 5 monclient: authenticate success, global_id 4626 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a685bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a5c003380 con 0x7f7a60083dc0 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 1 -- 10.20.193.21:0/1388601296 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a5c0037c0 con 0x7f7a60083dc0 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a6532e640 10 monclient: dump: 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a685bb640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.244+0000 7f7a685bb640 4 set_mon_vals no callback set 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 10 monclient: shutdown 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- 10.20.193.21:0/1388601296 >> v1:10.20.193.21:6789/0 conn(0x7f7a60083dc0 legacy=0x7f7a60164b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- 10.20.193.21:0/1388601296 shutdown_connections 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- 10.20.193.21:0/1388601296 >> 10.20.193.21:0/1388601296 conn(0x7f7a600b5300 msgr2=0x7f7a600b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- 10.20.193.21:0/1388601296 shutdown_connections 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- 10.20.193.21:0/1388601296 wait complete. 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 10 monclient: monmap: 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.247 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 librados: starting msgr at 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 librados: starting objecter 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 Processor -- start 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 -- start start 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 librados: setting wanted keys 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 1 librados: calling monclient init 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.245+0000 7f7a685bb640 10 monclient: init 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-b con 0x7f7a60083dc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-c con 0x7f7a6015e1b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient(hunting): picked mon.noname-a con 0x7f7a6015e580 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7fa1f0ff9640 1 -- 10.20.193.21:0/2326919429 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 213165853) 0x7fa1e805f170 con 0x7fa1f40ba350 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7fa1f0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7fa1f0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a60160530 con 0x7f7a6015e580 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a600b0860 con 0x7f7a60083dc0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a600b0b40 con 0x7f7a6015e1b0 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a685bb640 10 monclient(hunting): authenticate will time out at 3025.838413s 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stdout:94489280517 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a66b31640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f7a6015e580 0x7f7a601faaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47082/0 (socket says 10.20.193.21:47082) 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a66b31640 1 -- 10.20.193.21:0/2476714504 learned_addr learned my addr 10.20.193.21:0/2476714504 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a46ffd640 10 client.?.objecter ms_handle_connect 0x7f7a6015e580 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a46ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a46ffd640 10 client.?.objecter ms_handle_connect 0x7f7a60083dc0 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.246+0000 7f7a46ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 client.?.objecter ms_handle_connect 0x7f7a6015e1b0 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142446341 0 0) 0x7f7a600b0860 con 0x7f7a60083dc0 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): my global_id is 4621 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a30003610 con 0x7f7a60083dc0 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958816550 0 0) 0x7f7a60160530 con 0x7f7a6015e580 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 10 monclient(hunting): my global_id is 4629 2026-02-25T15:01:22.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.247+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a600b0860 con 0x7f7a6015e580 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265576689 0 0) 0x7f7a600b0b40 con 0x7f7a6015e1b0 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 10 monclient(hunting): my global_id is 4631 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.248+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a60160530 con 0x7f7a6015e1b0 2026-02-25T15:01:22.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 10 librados: watch_flush enter 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 10 librados: watch_flush exit 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 20 client.4619.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 10 client.4619.objecter successfully canceled tick 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 >> v1:10.20.193.72:6800/2463505645 conn(0x7fa1c4079ef0 legacy=0x7fa1c409a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 10 monclient: shutdown 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 >> v1:10.20.193.68:6789/0 conn(0x7fa1f40ba350 legacy=0x7fa1f41fb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 shutdown_connections 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 >> 10.20.193.21:0/2326919429 conn(0x7fa1f40b7990 msgr2=0x7fa1f40b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 shutdown_connections 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 -- 10.20.193.21:0/2326919429 wait complete. 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.249+0000 7fa1fa40c640 1 librados: shutdown 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1968630453 0 0) 0x7f7a30003610 con 0x7f7a60083dc0 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a600b0b40 con 0x7f7a60083dc0 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a50002f70 con 0x7f7a60083dc0 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.251 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1036969012 0 0) 0x7f7a600b0860 con 0x7f7a6015e580 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a30003610 con 0x7f7a6015e580 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a5c0036d0 con 0x7f7a6015e580 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.250+0000 7f7a46ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1635279945 0 0) 0x7f7a60160530 con 0x7f7a6015e1b0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a600b0860 con 0x7f7a6015e1b0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a54002fb0 con 0x7f7a6015e1b0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient(hunting): dump: 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1857339820 0 0) 0x7f7a600b0b40 con 0x7f7a60083dc0 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 >> v1:10.20.193.68:6789/0 conn(0x7f7a6015e1b0 legacy=0x7f7a6015fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 >> v1:10.20.193.21:6789/0 conn(0x7f7a6015e580 legacy=0x7f7a601faaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 monclient: found mon.b 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a600b0e20 con 0x7f7a60083dc0 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a685bb640 5 monclient: authenticate success, global_id 4621 2026-02-25T15:01:22.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a685bb640 10 monclient: _renew_subs 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.251+0000 7f7a685bb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a600b1100 con 0x7f7a60083dc0 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 10 client.4621.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 10 monclient: _renew_subs 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a600b16c0 con 0x7f7a60083dc0 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.252+0000 7f7a685bb640 1 librados: init done 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.253+0000 7f7a685bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.253+0000 7f7a685bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.253+0000 7f7a685bb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.254 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.253+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c005180 con 0x7f7a60083dc0 2026-02-25T15:01:22.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.7 2026-02-25T15:01:22.261 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a50003110 con 0x7f7a60083dc0 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7a500037d0 con 0x7f7a60083dc0 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a46ffd640 10 monclient: dump: 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.261 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.259+0000 7f7a64b2d640 4 set_mon_vals no callback set 2026-02-25T15:01:22.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.260+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f7a5001ccf0 con 0x7f7a60083dc0 2026-02-25T15:01:22.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a65b2f640 10 monclient: get_auth_request con 0x7f7a3007a0d0 auth_method 0 2026-02-25T15:01:22.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 10 client.4621.objecter ms_handle_connect 0x7f7a3007a0d0 2026-02-25T15:01:22.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f7a500947f0 con 0x7f7a60083dc0 2026-02-25T15:01:22.262 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 10 client.4621.objecter ms_dispatch2 0x7f7a60000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 3 client.4621.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 3 client.4621.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.263 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.261+0000 7f7a46ffd640 20 client.4621.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.281+0000 7f3d80b83640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:22.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.281+0000 7f3d80b83640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:22.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.281+0000 7f3d80b83640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.282 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.281+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3d7c0602b0 con 0x7f3d7c161800 2026-02-25T15:01:22.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.346+0000 7fb7c30e8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:22.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.346+0000 7fb7c30e8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:22.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.346+0000 7fb7c30e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.346+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fb7bc05e210 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7b17fa640 1 -- 10.20.193.21:0/1172460884 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 521551722) 0x7fb7b805f240 con 0x7fb7bc15d0c0 2026-02-25T15:01:22.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7b17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-25T15:01:22.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7b17fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.350 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 10 librados: watch_flush enter 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 10 librados: watch_flush exit 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 20 client.4628.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 10 client.4628.objecter successfully canceled tick 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 >> v1:10.20.193.72:6800/2463505645 conn(0x7fb78c079ee0 legacy=0x7fb78c09a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 10 monclient: shutdown 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.349+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 >> v1:10.20.193.68:6789/0 conn(0x7fb7bc15d0c0 legacy=0x7fb7bc1fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.350+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 shutdown_connections 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.350+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 >> 10.20.193.21:0/1172460884 conn(0x7fb7bc0b5290 msgr2=0x7fb7bc157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.350+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 shutdown_connections 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.350+0000 7fb7c30e8640 1 -- 10.20.193.21:0/1172460884 wait complete. 2026-02-25T15:01:22.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.350+0000 7fb7c30e8640 1 librados: shutdown 2026-02-25T15:01:22.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.355+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f7a5005e150 con 0x7f7a60083dc0 2026-02-25T15:01:22.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.355+0000 7f7a46ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.355+0000 7f7a46ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.358+0000 7f3d62ffd640 1 -- 10.20.193.21:0/3023694207 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1257367751) 0x7f3d6405ef10 con 0x7f3d7c161800 2026-02-25T15:01:22.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.358+0000 7f3d62ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-25T15:01:22.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.358+0000 7f3d62ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.10 2026-02-25T15:01:22.362 INFO:teuthology.orchestra.run.trial021.stdout:90194313220 2026-02-25T15:01:22.362 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 10 librados: watch_flush enter 2026-02-25T15:01:22.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 10 librados: watch_flush exit 2026-02-25T15:01:22.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 20 client.4615.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 10 client.4615.objecter successfully canceled tick 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3d48079fa0 legacy=0x7f3d4809a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 10 monclient: shutdown 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 >> v1:10.20.193.31:6789/0 conn(0x7f3d7c161800 legacy=0x7f3d7c0a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 shutdown_connections 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 >> 10.20.193.21:0/3023694207 conn(0x7f3d7c0b2ef0 msgr2=0x7f3d7c0b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 shutdown_connections 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 -- 10.20.193.21:0/3023694207 wait complete. 2026-02-25T15:01:22.365 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.361+0000 7f3d80b83640 1 librados: shutdown 2026-02-25T15:01:22.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.0 2026-02-25T15:01:22.371 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.461+0000 7f7a685bb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:22.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.461+0000 7f7a685bb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:22.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.461+0000 7f7a685bb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.461+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7a2c005470 con 0x7f7a60083dc0 2026-02-25T15:01:22.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.464+0000 7f7a46ffd640 1 -- 10.20.193.21:0/2476714504 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 521551722) 0x7f7a5005da50 con 0x7f7a60083dc0 2026-02-25T15:01:22.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.464+0000 7f7a46ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-25T15:01:22.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.464+0000 7f7a46ffd640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:22.465 INFO:teuthology.orchestra.run.trial021.stdout:94489280516 2026-02-25T15:01:22.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 10 librados: watch_flush enter 2026-02-25T15:01:22.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 10 librados: watch_flush exit 2026-02-25T15:01:22.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 20 client.4621.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 10 client.4621.objecter successfully canceled tick 2026-02-25T15:01:22.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 >> v1:10.20.193.72:6800/2463505645 conn(0x7f7a3007a0d0 legacy=0x7f7a3009a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 10 monclient: shutdown 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 >> v1:10.20.193.31:6789/0 conn(0x7f7a60083dc0 legacy=0x7f7a600b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 shutdown_connections 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 >> 10.20.193.21:0/2476714504 conn(0x7f7a600b5300 msgr2=0x7f7a60164760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 shutdown_connections 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 -- 10.20.193.21:0/2476714504 wait complete. 2026-02-25T15:01:22.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.465+0000 7f7a685bb640 1 librados: shutdown 2026-02-25T15:01:22.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.3 2026-02-25T15:01:22.475 DEBUG:teuthology.parallel:result is None 2026-02-25T15:01:22.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T15:01:22.476 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:01:22.543 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.541+0000 7f2e090c6640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.543 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.541+0000 7f2e090c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.543 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.541+0000 7f2e090c6640 10 monclient: monmap: 2026-02-25T15:01:22.543 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.542468+0000 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.542468+0000 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.544 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 1 Processor -- start 2026-02-25T15:01:22.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 1 -- start start 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient: init 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-b con 0x7f2e04058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-c con 0x7f2e040b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-a con 0x7f2e041626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e041655c0 con 0x7f2e041626a0 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e040b12b0 con 0x7f2e04058da0 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e040b1590 con 0x7f2e040b0410 2026-02-25T15:01:22.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.542+0000 7f2e090c6640 10 monclient(hunting): authenticate will time out at 3026.134759s 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.543+0000 7f2e02d76640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f2e04058da0 0x7f2e041647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:47740/0 (socket says 10.20.193.21:47740) 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.543+0000 7f2e02d76640 1 -- 10.20.193.21:0/2138869148 learned_addr learned my addr 10.20.193.21:0/2138869148 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273813758 0 0) 0x7f2e040b1590 con 0x7f2e040b0410 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): my global_id is 4634 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df0003610 con 0x7f2e040b0410 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780081901 0 0) 0x7f2e040b12b0 con 0x7f2e04058da0 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): my global_id is 4624 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e040b1590 con 0x7f2e04058da0 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527373515 0 0) 0x7f2e041655c0 con 0x7f2e041626a0 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 10 monclient(hunting): my global_id is 4632 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.544+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e040b12b0 con 0x7f2e041626a0 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 176301543 0 0) 0x7f2df0003610 con 0x7f2e040b0410 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 >> v1:10.20.193.31:6789/0 conn(0x7f2e04058da0 legacy=0x7f2e041647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 >> v1:10.20.193.21:6789/0 conn(0x7f2e041626a0 legacy=0x7f2e041c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 monclient: found mon.noname-c 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040b1870 con 0x7f2e040b0410 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dec002df0 con 0x7f2e040b0410 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:22.554 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 10 monclient: dump: 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.555 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e090c6640 5 monclient: authenticate success, global_id 4634 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e090c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.546+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2dec002fc0 con 0x7f2e040b0410 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e01d74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e01d74640 1 -- 10.20.193.21:0/2138869148 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dec003400 con 0x7f2e040b0410 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e01d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e01d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e01d74640 10 monclient: dump: 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.556 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 4 set_mon_vals no callback set 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 10 monclient: shutdown 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 -- 10.20.193.21:0/2138869148 >> v1:10.20.193.68:6789/0 conn(0x7f2e040b0410 legacy=0x7f2e04164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 -- 10.20.193.21:0/2138869148 shutdown_connections 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 -- 10.20.193.21:0/2138869148 >> 10.20.193.21:0/2138869148 conn(0x7f2e040b65f0 msgr2=0x7f2e040b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.557 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 -- 10.20.193.21:0/2138869148 shutdown_connections 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 -- 10.20.193.21:0/2138869148 wait complete. 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 10 monclient: monmap: 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.558 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 librados: starting msgr at 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.547+0000 7f2e090c6640 1 librados: starting objecter 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 Processor -- start 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 -- start start 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 librados: setting wanted keys 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 librados: calling monclient init 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient: init 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-a con 0x7f2e04058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-c con 0x7f2e040b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient(hunting): picked mon.noname-b con 0x7f2e041626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e04140230 con 0x7f2e04058da0 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e04136500 con 0x7f2e041626a0 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e04164db0 con 0x7f2e040b0410 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e090c6640 10 monclient(hunting): authenticate will time out at 3026.140571s 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e02575640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f2e040b0410 0x7f2e040a7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54640/0 (socket says 10.20.193.21:54640) 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.548+0000 7f2e02575640 1 -- 10.20.193.21:0/3311506327 learned_addr learned my addr 10.20.193.21:0/3311506327 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter ms_handle_connect 0x7f2e040b0410 2026-02-25T15:01:22.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter ms_handle_connect 0x7f2e041626a0 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter ms_handle_connect 0x7f2e04058da0 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448609191 0 0) 0x7f2e04164db0 con 0x7f2e040b0410 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 10 monclient(hunting): my global_id is 4637 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.549+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dd0003610 con 0x7f2e040b0410 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904892171 0 0) 0x7f2e04136500 con 0x7f2e041626a0 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): my global_id is 4627 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e04164db0 con 0x7f2e041626a0 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275495985 0 0) 0x7f2e04140230 con 0x7f2e04058da0 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 10 monclient(hunting): my global_id is 4635 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.550+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e04136500 con 0x7f2e04058da0 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1031328632 0 0) 0x7f2dd0003610 con 0x7f2e040b0410 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e04140230 con 0x7f2e040b0410 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dec003310 con 0x7f2e040b0410 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.566 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3036375120 0 0) 0x7f2e04164db0 con 0x7f2e041626a0 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dd0003610 con 0x7f2e041626a0 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2df4003330 con 0x7f2e041626a0 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.552+0000 7f2de37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1691159051 0 0) 0x7f2e04136500 con 0x7f2e04058da0 2026-02-25T15:01:22.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e04164db0 con 0x7f2e04058da0 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2df80030b0 con 0x7f2e04058da0 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.553+0000 7f2de37fe640 10 monclient(hunting): dump: 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.569 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2558942070 0 0) 0x7f2e04140230 con 0x7f2e040b0410 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 >> v1:10.20.193.31:6789/0 conn(0x7f2e041626a0 legacy=0x7f2e0425fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 >> v1:10.20.193.21:6789/0 conn(0x7f2e04058da0 legacy=0x7f2e041646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 1 monclient: found mon.c 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0413e8b0 con 0x7f2e040b0410 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2de37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 5 monclient: authenticate success, global_id 4637 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _renew_subs 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0405d300 con 0x7f2e040b0410 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 client.4637.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _renew_subs 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e04135d00 con 0x7f2e040b0410 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 1 librados: init done 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:22.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.554+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0413c500 con 0x7f2e040b0410 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2dec002fc0 con 0x7f2e040b0410 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2dec003b00 con 0x7f2e040b0410 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2de37fe640 10 monclient: dump: 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.643+0000 7f2e01573640 4 set_mon_vals no callback set 2026-02-25T15:01:22.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.644+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f2dec003ce0 con 0x7f2e040b0410 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.645+0000 7f2e02d76640 10 monclient: get_auth_request con 0x7f2dd007a180 auth_method 0 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.645+0000 7f2de37fe640 10 client.4637.objecter ms_handle_connect 0x7f2dd007a180 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.646+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f2dec095a10 con 0x7f2e040b0410 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.646+0000 7f2de37fe640 10 client.4637.objecter ms_dispatch2 0x7f2e04000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.646+0000 7f2de37fe640 3 client.4637.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.646+0000 7f2de37fe640 3 client.4637.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.646+0000 7f2de37fe640 20 client.4637.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.648+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f2dec05f370 con 0x7f2e040b0410 2026-02-25T15:01:22.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.648+0000 7f2de37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.648+0000 7f2de37fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:22.751 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.750+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e0413c220 con 0x7f2dd007a180 2026-02-25T15:01:22.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2de37fe640 1 -- 10.20.193.21:0/3311506327 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42966 (unknown 2965378022 0 1076077062) 0x7f2e0413c220 con 0x7f2dd007a180 2026-02-25T15:01:22.754 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 10 librados: watch_flush enter 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 10 librados: watch_flush exit 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 20 client.4637.objecter shutdown clearing up homeless session... 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 10 client.4637.objecter successfully canceled tick 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 >> v1:10.20.193.72:6800/2463505645 conn(0x7f2dd007a180 legacy=0x7f2dd009a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 10 monclient: shutdown 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 >> v1:10.20.193.68:6789/0 conn(0x7f2e040b0410 legacy=0x7f2e040a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 shutdown_connections 2026-02-25T15:01:22.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 >> 10.20.193.21:0/3311506327 conn(0x7f2e040b65f0 msgr2=0x7f2e04165360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 shutdown_connections 2026-02-25T15:01:22.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 -- 10.20.193.21:0/3311506327 wait complete. 2026-02-25T15:01:22.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.752+0000 7f2e090c6640 1 librados: shutdown 2026-02-25T15:01:22.763 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-25T15:01:21.727644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436752,"kb_used_data":5392,"kb_used_omap":127,"kb_used_meta":430976,"kb_avail":1509512688,"statfs":{"total":1546188226560,"available":1545740992512,"internally_reserved":0,"allocated":5521408,"data_stored":2907974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":130646,"internal_metadata":441319850},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000526"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.404894+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:01:17.404894+0000","last_peered":"2026-02-25T15:01:17.404894+0000","last_clean":"2026-02-25T15:01:17.404894+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:01:17.404894+0000","last_undegraded":"2026-02-25T15:01:17.404894+0000","last_fullsized":"2026-02-25T15:01:17.404894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.788598+0000","last_change":"2026-02-25T15:01:17.810911+0000","last_active":"2026-02-25T15:01:17.788598+0000","last_peered":"2026-02-25T15:01:17.788598+0000","last_clean":"2026-02-25T15:01:17.788598+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:01:17.788598+0000","last_undegraded":"2026-02-25T15:01:17.788598+0000","last_fullsized":"2026-02-25T15:01:17.788598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:24:11.882619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.745607+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:01:17.745607+0000","last_peered":"2026-02-25T15:01:17.745607+0000","last_clean":"2026-02-25T15:01:17.745607+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:01:17.745607+0000","last_undegraded":"2026-02-25T15:01:17.745607+0000","last_fullsized":"2026-02-25T15:01:17.745607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:40:33.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.726179+0000","last_change":"2026-02-25T15:01:17.750860+0000","last_active":"2026-02-25T15:01:17.726179+0000","last_peered":"2026-02-25T15:01:17.726179+0000","last_clean":"2026-02-25T15:01:17.726179+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:01:17.726179+0000","last_undegraded":"2026-02-25T15:01:17.726179+0000","last_fullsized":"2026-02-25T15:01:17.726179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:42:01.069031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.401550+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:01:17.401550+0000","last_peered":"2026-02-25T15:01:17.401550+0000","last_clean":"2026-02-25T15:01:17.401550+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:01:17.401550+0000","last_undegraded":"2026-02-25T15:01:17.401550+0000","last_fullsized":"2026-02-25T15:01:17.401550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.626293+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:01:17.626293+0000","last_peered":"2026-02-25T15:01:17.626293+0000","last_clean":"2026-02-25T15:01:17.626293+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:01:17.626293+0000","last_undegraded":"2026-02-25T15:01:17.626293+0000","last_fullsized":"2026-02-25T15:01:17.626293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.312967+0000","last_change":"2026-02-25T15:01:17.333599+0000","last_active":"2026-02-25T15:01:17.312967+0000","last_peered":"2026-02-25T15:01:17.312967+0000","last_clean":"2026-02-25T15:01:17.312967+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:01:17.312967+0000","last_undegraded":"2026-02-25T15:01:17.312967+0000","last_fullsized":"2026-02-25T15:01:17.312967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:49:45.844553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.369003+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:01:17.369003+0000","last_peered":"2026-02-25T15:01:17.369003+0000","last_clean":"2026-02-25T15:01:17.369003+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:01:17.369003+0000","last_undegraded":"2026-02-25T15:01:17.369003+0000","last_fullsized":"2026-02-25T15:01:17.369003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.457777+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:01:17.457777+0000","last_peered":"2026-02-25T15:01:17.457777+0000","last_clean":"2026-02-25T15:01:17.457777+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:01:17.457777+0000","last_undegraded":"2026-02-25T15:01:17.457777+0000","last_fullsized":"2026-02-25T15:01:17.457777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,4,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[1,2,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,3,4,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,3,4,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,3,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[1,2,3,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":124355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8120,"internal_metadata":27582536},"hb_peers":[0,1,2,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6180,"internal_metadata":27584476},"hb_peers":[0,1,2,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8126,"internal_metadata":27582530},"hb_peers":[0,1,2,3,4,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5525,"internal_metadata":27585131},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":124355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:01:22.765 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 10 monclient: get_monmap_and_config 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 10 monclient: monmap: 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:22.832923+0000 2026-02-25T15:01:22.834 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:22.832923+0000 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.835 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 1 Processor -- start 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 1 -- start start 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.832+0000 7f77a5bb3640 10 monclient: init 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-c con 0x7f77a0055bf0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-a con 0x7f77a0164040 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-b con 0x7f77a0055fc0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a00b3a00 con 0x7f77a0164040 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a00b3c70 con 0x7f77a0055fc0 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a00b3f50 con 0x7f77a0055bf0 2026-02-25T15:01:22.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f77a5bb3640 10 monclient(hunting): authenticate will time out at 3026.425310s 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f779effd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f77a0164040 0x7f77a0056690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47106/0 (socket says 10.20.193.21:47106) 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.833+0000 7f779effd640 1 -- 10.20.193.21:0/307943902 learned_addr learned my addr 10.20.193.21:0/307943902 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600216722 0 0) 0x7f77a00b3a00 con 0x7f77a0164040 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): my global_id is 4638 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7784003610 con 0x7f77a0164040 2026-02-25T15:01:22.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298131112 0 0) 0x7f77a00b3f50 con 0x7f77a0055bf0 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): my global_id is 4640 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a00b3a00 con 0x7f77a0055bf0 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057952832 0 0) 0x7f77a00b3c70 con 0x7f77a0055fc0 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 10 monclient(hunting): my global_id is 4630 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.835+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a00b3f50 con 0x7f77a0055fc0 2026-02-25T15:01:22.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4181879066 0 0) 0x7f77a00b3f50 con 0x7f77a0055fc0 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 >> v1:10.20.193.68:6789/0 conn(0x7f77a0055bf0 legacy=0x7f77a00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 >> v1:10.20.193.21:6789/0 conn(0x7f77a0164040 legacy=0x7f77a0056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 monclient: found mon.noname-b 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a00b4230 con 0x7f77a0055fc0 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.842 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7794003150 con 0x7f77a0055fc0 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.836+0000 7f779e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: dump: 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.843 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f77a5bb3640 5 monclient: authenticate success, global_id 4630 2026-02-25T15:01:22.844 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f77a5bb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7794003320 con 0x7f77a0055fc0 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 1 -- 10.20.193.21:0/307943902 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7794003760 con 0x7f77a0055fc0 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f779e7fc640 10 monclient: dump: 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.850 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f77a5bb3640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:22.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.837+0000 7f77a5bb3640 4 set_mon_vals no callback set 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 10 monclient: shutdown 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 -- 10.20.193.21:0/307943902 >> v1:10.20.193.31:6789/0 conn(0x7f77a0055fc0 legacy=0x7f77a00b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 -- 10.20.193.21:0/307943902 shutdown_connections 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 -- 10.20.193.21:0/307943902 >> 10.20.193.21:0/307943902 conn(0x7f77a00b7bb0 msgr2=0x7f77a00b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 -- 10.20.193.21:0/307943902 shutdown_connections 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 -- 10.20.193.21:0/307943902 wait complete. 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 10 monclient: build_initial_monmap 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 10 monclient: monmap: 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:22.852 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.838+0000 7f77a5bb3640 1 librados: starting msgr at 2026-02-25T15:01:22.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 librados: starting objecter 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 Processor -- start 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 -- start start 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 librados: setting wanted keys 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 librados: calling monclient init 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient: init 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-c con 0x7f77a0055bf0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:22.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-a con 0x7f77a0055fc0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient(hunting): picked mon.noname-b con 0x7f77a0164040 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a013aaf0 con 0x7f77a0055fc0 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a0162e20 con 0x7f77a0164040 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a013d0d0 con 0x7f77a0055bf0 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f77a5bb3640 10 monclient(hunting): authenticate will time out at 3026.431536s 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f779effd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f77a0055fc0 0x7f77a0139da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47108/0 (socket says 10.20.193.21:47108) 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f779effd640 1 -- 10.20.193.21:0/2191484915 learned_addr learned my addr 10.20.193.21:0/2191484915 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.839+0000 7f777bfff640 10 client.?.objecter ms_handle_connect 0x7f77a0055fc0 2026-02-25T15:01:22.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 10 client.?.objecter ms_handle_connect 0x7f77a0164040 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 10 client.?.objecter ms_handle_connect 0x7f77a0055bf0 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.840+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932656048 0 0) 0x7f77a0162e20 con 0x7f77a0164040 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): my global_id is 4633 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7770003610 con 0x7f77a0164040 2026-02-25T15:01:22.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469753305 0 0) 0x7f77a013aaf0 con 0x7f77a0055fc0 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): my global_id is 4641 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a0162e20 con 0x7f77a0055fc0 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379691591 0 0) 0x7f77a013d0d0 con 0x7f77a0055bf0 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:22.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 10 monclient(hunting): my global_id is 4643 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.841+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a013aaf0 con 0x7f77a0055bf0 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 253616853 0 0) 0x7f7770003610 con 0x7f77a0164040 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77a013d0d0 con 0x7f77a0164040 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7794003670 con 0x7f77a0164040 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): dump: 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.858 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1232276892 0 0) 0x7f77a0162e20 con 0x7f77a0055fc0 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7770003610 con 0x7f77a0055fc0 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7790002fd0 con 0x7f77a0055fc0 2026-02-25T15:01:22.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.843+0000 7f777bfff640 10 monclient(hunting): dump: 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.860 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1004565869 0 0) 0x7f77a013aaf0 con 0x7f77a0055bf0 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77a0162e20 con 0x7f77a0055bf0 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f778c0030b0 con 0x7f77a0055bf0 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.844+0000 7f777bfff640 10 monclient(hunting): dump: 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.861 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 573403773 0 0) 0x7f77a013d0d0 con 0x7f77a0164040 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 >> v1:10.20.193.68:6789/0 conn(0x7f77a0055bf0 legacy=0x7f77a0162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 >> v1:10.20.193.21:6789/0 conn(0x7f77a0055fc0 legacy=0x7f77a0139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 1 monclient: found mon.b 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:22.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a013d3b0 con 0x7f77a0164040 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 10 monclient: _finish_auth 0 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f777bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 5 monclient: authenticate success, global_id 4633 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _renew_subs 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f77a013d690 con 0x7f77a0164040 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 client.4633.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _renew_subs 2026-02-25T15:01:22.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f77a013a4b0 con 0x7f77a0164040 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 1 librados: init done 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:01:22.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.845+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a0139a00 con 0x7f77a0164040 2026-02-25T15:01:22.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77940032d0 con 0x7f77a0164040 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f7794003e60 con 0x7f77a0164040 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f779dffb640 4 set_mon_vals no callback set 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 10 monclient: dump: 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:22.866 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.853+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f779401d340 con 0x7f77a0164040 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.854+0000 7f779f7fe640 10 monclient: get_auth_request con 0x7f777007a0c0 auth_method 0 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.854+0000 7f777bfff640 10 client.4633.objecter ms_handle_connect 0x7f777007a0c0 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.855+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f7794094b00 con 0x7f77a0164040 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.855+0000 7f777bfff640 10 client.4633.objecter ms_dispatch2 0x7f77a0000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.855+0000 7f777bfff640 3 client.4633.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.855+0000 7f777bfff640 3 client.4633.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:22.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.855+0000 7f777bfff640 20 client.4633.objecter dump_active .. 0 homeless 2026-02-25T15:01:22.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.942+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f779405e460 con 0x7f77a0164040 2026-02-25T15:01:22.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.942+0000 7f777bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:22.943 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:22.942+0000 7f777bfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:23.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.045+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f77a0139690 con 0x7f777007a0c0 2026-02-25T15:01:23.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f777bfff640 1 -- 10.20.193.21:0/2191484915 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42966 (unknown 2965378022 0 1076077062) 0x7f77a0139690 con 0x7f777007a0c0 2026-02-25T15:01:23.049 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:23.050 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:01:23.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 10 librados: watch_flush enter 2026-02-25T15:01:23.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 10 librados: watch_flush exit 2026-02-25T15:01:23.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 20 client.4633.objecter shutdown clearing up homeless session... 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 10 client.4633.objecter successfully canceled tick 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 >> v1:10.20.193.72:6800/2463505645 conn(0x7f777007a0c0 legacy=0x7f777009a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 10 monclient: shutdown 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 >> v1:10.20.193.31:6789/0 conn(0x7f77a0164040 legacy=0x7f77a012e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 shutdown_connections 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 >> 10.20.193.21:0/2191484915 conn(0x7f77a00b7bb0 msgr2=0x7f77a00b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 shutdown_connections 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 -- 10.20.193.21:0/2191484915 wait complete. 2026-02-25T15:01:23.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.047+0000 7f77a5bb3640 1 librados: shutdown 2026-02-25T15:01:23.058 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-25T15:01:21.727644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436752,"kb_used_data":5392,"kb_used_omap":127,"kb_used_meta":430976,"kb_avail":1509512688,"statfs":{"total":1546188226560,"available":1545740992512,"internally_reserved":0,"allocated":5521408,"data_stored":2907974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":130646,"internal_metadata":441319850},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000526"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.404894+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:01:17.404894+0000","last_peered":"2026-02-25T15:01:17.404894+0000","last_clean":"2026-02-25T15:01:17.404894+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:01:17.404894+0000","last_undegraded":"2026-02-25T15:01:17.404894+0000","last_fullsized":"2026-02-25T15:01:17.404894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.788598+0000","last_change":"2026-02-25T15:01:17.810911+0000","last_active":"2026-02-25T15:01:17.788598+0000","last_peered":"2026-02-25T15:01:17.788598+0000","last_clean":"2026-02-25T15:01:17.788598+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:01:17.788598+0000","last_undegraded":"2026-02-25T15:01:17.788598+0000","last_fullsized":"2026-02-25T15:01:17.788598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:24:11.882619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.745607+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:01:17.745607+0000","last_peered":"2026-02-25T15:01:17.745607+0000","last_clean":"2026-02-25T15:01:17.745607+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:01:17.745607+0000","last_undegraded":"2026-02-25T15:01:17.745607+0000","last_fullsized":"2026-02-25T15:01:17.745607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:40:33.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.726179+0000","last_change":"2026-02-25T15:01:17.750860+0000","last_active":"2026-02-25T15:01:17.726179+0000","last_peered":"2026-02-25T15:01:17.726179+0000","last_clean":"2026-02-25T15:01:17.726179+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:01:17.726179+0000","last_undegraded":"2026-02-25T15:01:17.726179+0000","last_fullsized":"2026-02-25T15:01:17.726179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:42:01.069031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.401550+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:01:17.401550+0000","last_peered":"2026-02-25T15:01:17.401550+0000","last_clean":"2026-02-25T15:01:17.401550+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:01:17.401550+0000","last_undegraded":"2026-02-25T15:01:17.401550+0000","last_fullsized":"2026-02-25T15:01:17.401550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.626293+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:01:17.626293+0000","last_peered":"2026-02-25T15:01:17.626293+0000","last_clean":"2026-02-25T15:01:17.626293+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:01:17.626293+0000","last_undegraded":"2026-02-25T15:01:17.626293+0000","last_fullsized":"2026-02-25T15:01:17.626293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.312967+0000","last_change":"2026-02-25T15:01:17.333599+0000","last_active":"2026-02-25T15:01:17.312967+0000","last_peered":"2026-02-25T15:01:17.312967+0000","last_clean":"2026-02-25T15:01:17.312967+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:01:17.312967+0000","last_undegraded":"2026-02-25T15:01:17.312967+0000","last_fullsized":"2026-02-25T15:01:17.312967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:49:45.844553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.369003+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:01:17.369003+0000","last_peered":"2026-02-25T15:01:17.369003+0000","last_clean":"2026-02-25T15:01:17.369003+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:01:17.369003+0000","last_undegraded":"2026-02-25T15:01:17.369003+0000","last_fullsized":"2026-02-25T15:01:17.369003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T15:01:17.457777+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:01:17.457777+0000","last_peered":"2026-02-25T15:01:17.457777+0000","last_clean":"2026-02-25T15:01:17.457777+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:01:17.457777+0000","last_undegraded":"2026-02-25T15:01:17.457777+0000","last_fullsized":"2026-02-25T15:01:17.457777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8125,"internal_metadata":27582531},"hb_peers":[0,1,2,4,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[1,2,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,3,4,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,3,4,5,6,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,2,4,5,6,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,5,6,7,8,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[0,1,2,3,5,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,9,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":583616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8774,"internal_metadata":27581882},"hb_peers":[0,1,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7474,"internal_metadata":27583182},"hb_peers":[1,2,3,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":124355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8120,"internal_metadata":27582536},"hb_peers":[0,1,2,5,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6180,"internal_metadata":27584476},"hb_peers":[0,1,2,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8126,"internal_metadata":27582530},"hb_peers":[0,1,2,3,4,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":5,"kb_used_meta":26938,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":124336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5525,"internal_metadata":27585131},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":124355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:01:23.060 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T15:01:23.060 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T15:01:23.060 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T15:01:23.060 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.125+0000 7f6096408640 10 monclient: get_monmap_and_config 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.125+0000 7f6096408640 10 monclient: build_initial_monmap 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.125+0000 7f6096408640 10 monclient: monmap: 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:01:23.126678+0000 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:01:23.126678+0000 2026-02-25T15:01:23.128 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 1 Processor -- start 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 1 -- start start 2026-02-25T15:01:23.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient: init 2026-02-25T15:01:23.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient(hunting): picked mon.noname-c con 0x7f6090058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient(hunting): picked mon.noname-b con 0x7f60900b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient(hunting): picked mon.noname-a con 0x7f60901626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60901655c0 con 0x7f60901626a0 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60900b12b0 con 0x7f60900b0410 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60900b1590 con 0x7f6090058da0 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:23.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.126+0000 7f6096408640 10 monclient(hunting): authenticate will time out at 3026.718954s 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.127+0000 7f608ffff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f6090058da0 0x7f60901647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:54672/0 (socket says 10.20.193.21:54672) 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.127+0000 7f608ffff640 1 -- 10.20.193.21:0/1940887426 learned_addr learned my addr 10.20.193.21:0/1940887426 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.127+0000 7f609497e640 1 --1- 10.20.193.21:0/1940887426 >> v1:10.20.193.21:6789/0 conn(0x7f60901626a0 0x7f60901c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47118/0 (socket says 10.20.193.21:47118) 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957179748 0 0) 0x7f60901655c0 con 0x7f60901626a0 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): my global_id is 4644 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6074003610 con 0x7f60901626a0 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327684103 0 0) 0x7f60900b1590 con 0x7f6090058da0 2026-02-25T15:01:23.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): my global_id is 4646 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60901655c0 con 0x7f6090058da0 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071448019 0 0) 0x7f60900b12b0 con 0x7f60900b0410 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 10 monclient(hunting): my global_id is 4636 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.128+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60900b1590 con 0x7f60900b0410 2026-02-25T15:01:23.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3291752862 0 0) 0x7f60901655c0 con 0x7f6090058da0 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 >> v1:10.20.193.31:6789/0 conn(0x7f60900b0410 legacy=0x7f6090164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 >> v1:10.20.193.21:6789/0 conn(0x7f60901626a0 legacy=0x7f60901c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: _finish_hunting 0 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 monclient: found mon.noname-c 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60900b1870 con 0x7f6090058da0 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: _finish_auth 0 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: _check_auth_tickets 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:23.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f607c002df0 con 0x7f6090058da0 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f608effd640 10 monclient: dump: 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.137 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.138 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.138 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f6096408640 5 monclient: authenticate success, global_id 4646 2026-02-25T15:01:23.138 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.130+0000 7f6096408640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:23.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f607c002f90 con 0x7f6090058da0 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 1 -- 10.20.193.21:0/1940887426 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f607c0033d0 con 0x7f6090058da0 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 10 monclient: get_monmap_and_config success 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 4 set_mon_vals no callback set 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f608effd640 10 monclient: dump: 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.145 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 10 monclient: shutdown 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 1 -- 10.20.193.21:0/1940887426 >> v1:10.20.193.68:6789/0 conn(0x7f6090058da0 legacy=0x7f60901647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 1 -- 10.20.193.21:0/1940887426 shutdown_connections 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 1 -- 10.20.193.21:0/1940887426 >> 10.20.193.21:0/1940887426 conn(0x7f60900b65f0 msgr2=0x7f60900b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 1 -- 10.20.193.21:0/1940887426 shutdown_connections 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.131+0000 7f6096408640 1 -- 10.20.193.21:0/1940887426 wait complete. 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 10 monclient: build_initial_monmap 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 10 monclient: monmap: 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:01:23.147 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 librados: starting msgr at 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 librados: starting objecter 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 Processor -- start 2026-02-25T15:01:23.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 -- start start 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 librados: setting wanted keys 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 1 librados: calling monclient init 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.132+0000 7f6096408640 10 monclient: init 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient: _reopen_session rank -1 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient(hunting): picked mon.noname-a con 0x7f6090058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient(hunting): picked mon.noname-c con 0x7f60900b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient(hunting): picked mon.noname-b con 0x7f60901626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6090141560 con 0x7f6090058da0 2026-02-25T15:01:23.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609015e690 con 0x7f60901626a0 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60901488c0 con 0x7f60900b0410 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient(hunting): _renew_subs 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f6096408640 10 monclient(hunting): authenticate will time out at 3026.725094s 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608ffff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f6090058da0 0x7f6090149c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:47130/0 (socket says 10.20.193.21:47130) 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608ffff640 1 -- 10.20.193.21:0/3388259876 learned_addr learned my addr 10.20.193.21:0/3388259876 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter ms_handle_connect 0x7f6090058da0 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter ms_handle_connect 0x7f60900b0410 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter ms_handle_connect 0x7f60901626a0 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.133+0000 7f608cff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:23.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459388714 0 0) 0x7f6090141560 con 0x7f6090058da0 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): my global_id is 4647 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6060003610 con 0x7f6090058da0 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138337510 0 0) 0x7f60901488c0 con 0x7f60900b0410 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): my global_id is 4649 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6090141560 con 0x7f60900b0410 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882224188 0 0) 0x7f609015e690 con 0x7f60901626a0 2026-02-25T15:01:23.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _negotiate 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 10 monclient(hunting): my global_id is 4639 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.134+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60901488c0 con 0x7f60901626a0 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1106557633 0 0) 0x7f6060003610 con 0x7f6090058da0 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f609015e690 con 0x7f6090058da0 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f607c003320 con 0x7f6090058da0 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 10 monclient(hunting): dump: 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.152 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.136+0000 7f608cff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1187520658 0 0) 0x7f60901488c0 con 0x7f60901626a0 2026-02-25T15:01:23.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6060003610 con 0x7f60901626a0 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6084003270 con 0x7f60901626a0 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): dump: 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.154 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1781943744 0 0) 0x7f6090141560 con 0x7f60900b0410 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60901488c0 con 0x7f60900b0410 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6080003060 con 0x7f60900b0410 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.137+0000 7f608cff9640 10 monclient(hunting): dump: 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.155 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1318215883 0 0) 0x7f609015e690 con 0x7f6090058da0 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 >> v1:10.20.193.68:6789/0 conn(0x7f60900b0410 legacy=0x7f6090057550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 >> v1:10.20.193.31:6789/0 conn(0x7f60901626a0 legacy=0x7f60901461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 10 monclient: _finish_hunting 0 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 1 monclient: found mon.a 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:23.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6090148ba0 con 0x7f6090058da0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 10 monclient: _finish_auth 0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 10 monclient: _check_auth_tickets 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f608cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 5 monclient: authenticate success, global_id 4647 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _renew_subs 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6090148e80 con 0x7f6090058da0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 client.4647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _renew_subs 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6090149440 con 0x7f6090058da0 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 1 librados: init done 2026-02-25T15:01:23.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:23.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:23.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:23.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.138+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6090165340 con 0x7f6090058da0 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f607c002f70 con 0x7f6090058da0 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f607c004d20 con 0x7f6090058da0 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608cff9640 10 monclient: dump: 2026-02-25T15:01:23.159 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.146+0000 7f608e7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:23.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.147+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f607c004f00 con 0x7f6090058da0 2026-02-25T15:01:23.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.147+0000 7f608f7fe640 10 monclient: get_auth_request con 0x7f606007a110 auth_method 0 2026-02-25T15:01:23.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.148+0000 7f608cff9640 10 client.4647.objecter ms_handle_connect 0x7f606007a110 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7f607c095ae0 con 0x7f6090058da0 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 10 client.4647.objecter ms_dispatch2 0x7f6090000b90 osd_map(30..30 src has 1..30) 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 3 client.4647.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 3 client.4647.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 20 client.4647.objecter dump_active .. 0 homeless 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f6090165340 con 0x7f6090058da0 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:01:23.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.231+0000 7f608cff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:01:23.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.362+0000 7f6096408640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-25T15:01:23.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.362+0000 7f6096408640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-25T15:01:23.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.362+0000 7f6096408640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:01:23.364 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.362+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6090163ee0 con 0x7f6090058da0 2026-02-25T15:01:23.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.391+0000 7f608cff9640 1 -- 10.20.193.21:0/3388259876 <== mon.0 v1:10.20.193.21:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f607c004d20 con 0x7f6090058da0 2026-02-25T15:01:23.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.391+0000 7f608cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-25T15:01:23.393 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.391+0000 7f608cff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:01:23.394 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:01:23.394 INFO:teuthology.orchestra.run.trial021.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T15:01:23.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 10 librados: watch_flush enter 2026-02-25T15:01:23.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 10 librados: watch_flush exit 2026-02-25T15:01:23.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 20 client.4647.objecter shutdown clearing up homeless session... 2026-02-25T15:01:23.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 10 client.4647.objecter successfully canceled tick 2026-02-25T15:01:23.396 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 >> v1:10.20.193.72:6800/2463505645 conn(0x7f606007a110 legacy=0x7f606009a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 10 monclient: shutdown 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 >> v1:10.20.193.21:6789/0 conn(0x7f6090058da0 legacy=0x7f6090149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 shutdown_connections 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 >> 10.20.193.21:0/3388259876 conn(0x7f60900b65f0 msgr2=0x7f609013fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 shutdown_connections 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 -- 10.20.193.21:0/3388259876 wait complete. 2026-02-25T15:01:23.397 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:01:23.394+0000 7f6096408640 1 librados: shutdown 2026-02-25T15:01:23.405 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T15:01:23.406 INFO:teuthology.run_tasks:Running task workunit... 2026-02-25T15:01:23.434 INFO:tasks.workunit:Pulling workunits from ref c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T15:01:23.435 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-25T15:01:23.435 DEBUG:teuthology.orchestra.run.trial072:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:01:23.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:01:23.454 INFO:teuthology.orchestra.run.trial072.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-25T15:01:23.455 DEBUG:teuthology.orchestra.run.trial072:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:01:23.511 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-25T15:01:23.512 DEBUG:teuthology.orchestra.run.trial072:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-25T15:01:23.568 INFO:tasks.workunit:timeout=6h 2026-02-25T15:01:23.568 INFO:tasks.workunit:cleanup=True 2026-02-25T15:01:23.569 DEBUG:teuthology.orchestra.run.trial072:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c824a7fa29b067db9ce5a381f59b175918299919 2026-02-25T15:01:23.632 INFO:tasks.workunit.client.0.trial072.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-25T15:01:26.645 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:08.802 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.673 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:08.831 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.691 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:08.885 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.692 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:08.884 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.717 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:08.911 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.719 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:08.911 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.798 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:08.955 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.837 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:09.031 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:26.844 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:09.036 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.652 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:28.809 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.653 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:28.810 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.679 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:28.872 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.679 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:28.871 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.680 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:28.838 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.681 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:28.875 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.681 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:28.873 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr:Note: switching to 'c824a7fa29b067db9ce5a381f59b175918299919'. 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr:state without impacting any branches by switching back to a branch. 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.683 INFO:tasks.workunit.client.0.trial072.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: git switch -c 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr:Or undo this operation with: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: git switch - 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr: 2026-02-25T15:01:46.684 INFO:tasks.workunit.client.0.trial072.stderr:HEAD is now at c824a7fa29b Merge PR #65949 into tentacle 2026-02-25T15:01:46.689 DEBUG:teuthology.orchestra.run.trial072:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-25T15:01:46.699 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:28.893 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.699 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:28.891 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:01:46.746 INFO:tasks.workunit.client.0.trial072.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-25T15:01:46.748 INFO:tasks.workunit.client.0.trial072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T15:01:46.748 INFO:tasks.workunit.client.0.trial072.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-25T15:01:46.834 INFO:tasks.workunit.client.0.trial072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-25T15:01:46.863 INFO:tasks.workunit.client.0.trial072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-25T15:01:46.887 INFO:tasks.workunit.client.0.trial072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-25T15:01:46.889 INFO:tasks.workunit.client.0.trial072.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T15:01:46.889 INFO:tasks.workunit.client.0.trial072.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-25T15:01:46.913 INFO:tasks.workunit.client.0.trial072.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-25T15:01:46.916 DEBUG:teuthology.orchestra.run.trial072:> set -ex 2026-02-25T15:01:46.917 DEBUG:teuthology.orchestra.run.trial072:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-25T15:01:46.972 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-25T15:01:46.973 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-25T15:01:46.973 DEBUG:teuthology.orchestra.run.trial072:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c824a7fa29b067db9ce5a381f59b175918299919 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ parallel=1 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' '' = --serial ']' 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ crimson=0 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' '' = --crimson ']' 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ color= 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -t 1 ']' 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ declare -A pids 2026-02-25T15:01:47.033 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.034 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.034 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_aio 2026-02-25T15:01:47.034 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_aio' 2026-02-25T15:01:47.034 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_aio 2026-02-25T15:01:47.034 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_aio 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49411 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_aio on pid 49411' 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stdout:test api_aio on pid 49411 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49411 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-25T15:01:47.036 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_aio_pp 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_aio_pp' 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_aio_pp 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.037 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_aio_pp 2026-02-25T15:01:47.038 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49418 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stdout:test api_aio_pp on pid 49418 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_aio_pp on pid 49418' 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49418 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_io 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_io' 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_io 2026-02-25T15:01:47.039 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.040 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.041 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_io 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49427 2026-02-25T15:01:47.042 INFO:tasks.workunit.client.0.trial072.stdout:test api_io on pid 49427 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_io on pid 49427' 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49427 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-25T15:01:47.043 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_io_pp 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_io_pp' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_io_pp 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.044 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_io_pp 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49439 2026-02-25T15:01:47.045 INFO:tasks.workunit.client.0.trial072.stdout:test api_io_pp on pid 49439 2026-02-25T15:01:47.047 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_io_pp on pid 49439' 2026-02-25T15:01:47.047 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49439 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_asio 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_asio' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_asio 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.048 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.049 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_asio 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49453 2026-02-25T15:01:47.050 INFO:tasks.workunit.client.0.trial072.stdout:test api_asio on pid 49453 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_asio on pid 49453' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49453 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_list 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_list' 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.053 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_list 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.054 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.055 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49411/exe ']' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_list 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49469 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_list on pid 49469' 2026-02-25T15:01:47.056 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49469 2026-02-25T15:01:47.057 INFO:tasks.workunit.client.0.trial072.stdout:test api_list on pid 49469 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49411/exe 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_lock 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.059 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_lock' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_lock 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.060 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.061 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.062 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49418/exe ']' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_aio: /' 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49418/exe 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_lock 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49489 2026-02-25T15:01:47.063 INFO:tasks.workunit.client.0.trial072.stdout:test api_lock on pid 49489 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_lock on pid 49489' 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49489 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_lock_pp 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_lock_pp' 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_lock_pp 2026-02-25T15:01:47.066 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.067 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.068 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.069 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49427/exe ']' 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_lock_pp 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49508 2026-02-25T15:01:47.070 INFO:tasks.workunit.client.0.trial072.stdout:test api_lock_pp on pid 49508 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_lock_pp on pid 49508' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49508 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_misc 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49427/exe 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_misc' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_misc 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.073 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.074 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.075 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49439/exe ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_io.log 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49439/exe 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_io: /' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_misc 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49531 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_misc on pid 49531' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.076 INFO:tasks.workunit.client.0.trial072.stdout:test api_misc on pid 49531 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49531 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_misc_pp 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_misc_pp' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_misc_pp 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.079 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.080 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.081 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49453/exe ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49453/exe 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_misc_pp 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49553 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_misc_pp on pid 49553' 2026-02-25T15:01:47.082 INFO:tasks.workunit.client.0.trial072.stdout:test api_misc_pp on pid 49553 2026-02-25T15:01:47.084 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49553 2026-02-25T15:01:47.084 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_pool 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_pool' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_pool 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.085 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.086 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49469/exe ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49469/exe 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_asio: /' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.087 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_pool 2026-02-25T15:01:47.088 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49572 2026-02-25T15:01:47.088 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_pool on pid 49572' 2026-02-25T15:01:47.088 INFO:tasks.workunit.client.0.trial072.stdout:test api_pool on pid 49572 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49572 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_snapshots 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_snapshots' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.090 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_snapshots 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49489/exe ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_list.log 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.091 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_list: /' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49489/exe 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.092 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_snapshots 2026-02-25T15:01:47.093 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49590 2026-02-25T15:01:47.093 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_snapshots on pid 49590' 2026-02-25T15:01:47.093 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49590 2026-02-25T15:01:47.093 INFO:tasks.workunit.client.0.trial072.stdout:test api_snapshots on pid 49590 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_snapshots_pp 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_snapshots_pp' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.095 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_snapshots_pp 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_lock: /' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49508/exe ']' 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.096 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49508/exe 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_snapshots_pp 2026-02-25T15:01:47.097 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.098 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49612 2026-02-25T15:01:47.098 INFO:tasks.workunit.client.0.trial072.stdout:test api_snapshots_pp on pid 49612 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_snapshots_pp on pid 49612' 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49612 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-25T15:01:47.099 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_stat 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_stat' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_stat 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.100 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49531/exe ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49531/exe 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.101 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_stat 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49647 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_stat on pid 49647' 2026-02-25T15:01:47.102 INFO:tasks.workunit.client.0.trial072.stdout:test api_stat on pid 49647 2026-02-25T15:01:47.104 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49647 2026-02-25T15:01:47.104 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.104 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.104 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_stat_pp 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_stat_pp' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.105 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_stat_pp 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_misc: /' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.106 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49553/exe ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49553/exe 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_stat_pp 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49673 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_stat_pp on pid 49673' 2026-02-25T15:01:47.107 INFO:tasks.workunit.client.0.trial072.stdout:test api_stat_pp on pid 49673 2026-02-25T15:01:47.109 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49673 2026-02-25T15:01:47.109 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.109 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_watch_notify 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_watch_notify' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.110 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_watch_notify 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49572/exe ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.111 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49572/exe 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_watch_notify 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49709 2026-02-25T15:01:47.112 INFO:tasks.workunit.client.0.trial072.stdout:test api_watch_notify on pid 49709 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_watch_notify on pid 49709' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49709 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_watch_notify_pp 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.115 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49590/exe ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_watch_notify_pp' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_pool: /' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_watch_notify_pp 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49590/exe 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.116 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.117 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_watch_notify_pp 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49731 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.118 INFO:tasks.workunit.client.0.trial072.stdout:test api_watch_notify_pp on pid 49731 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_watch_notify_pp on pid 49731' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49731 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_cmd 2026-02-25T15:01:47.120 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_cmd' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_cmd 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49612/exe ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.121 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49612/exe 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_cmd 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49755 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_cmd on pid 49755' 2026-02-25T15:01:47.122 INFO:tasks.workunit.client.0.trial072.stdout:test api_cmd on pid 49755 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49755 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_cmd_pp 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49647/exe ']' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_cmd_pp' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.125 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49647/exe 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_cmd_pp 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.126 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.127 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_cmd_pp 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49787 2026-02-25T15:01:47.128 INFO:tasks.workunit.client.0.trial072.stdout:test api_cmd_pp on pid 49787 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_cmd_pp on pid 49787' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49787 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_service 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_stat: /' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_service' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_service 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.130 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.131 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49673/exe ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49673/exe 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_service 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49839 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_service on pid 49839' 2026-02-25T15:01:47.132 INFO:tasks.workunit.client.0.trial072.stdout:test api_service on pid 49839 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49839 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_service_pp 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_service_pp' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.134 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_service_pp 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49709/exe ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.135 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49709/exe 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.136 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_service_pp 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49862 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_service_pp on pid 49862' 2026-02-25T15:01:47.137 INFO:tasks.workunit.client.0.trial072.stdout:test api_service_pp on pid 49862 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49862 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.139 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_c_write_operations 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_c_write_operations' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_c_write_operations 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.140 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49731/exe ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.141 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49731/exe 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_c_write_operations 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49889 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_c_write_operations on pid 49889' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.142 INFO:tasks.workunit.client.0.trial072.stdout:test api_c_write_operations on pid 49889 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49889 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.144 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s api_c_read_operations 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' api_c_read_operations' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49755/exe ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ echo api_c_read_operations 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.145 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49755/exe 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.146 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=api_c_read_operations 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49916 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test api_c_read_operations on pid 49916' 2026-02-25T15:01:47.147 INFO:tasks.workunit.client.0.trial072.stdout:test api_c_read_operations on pid 49916 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49916 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s list_parallel 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' list_parallel' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_cmd: /' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.149 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ echo list_parallel 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49787/exe ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49787/exe 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.150 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=list_parallel 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49948 2026-02-25T15:01:47.151 INFO:tasks.workunit.client.0.trial072.stdout:test list_parallel on pid 49948 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test list_parallel on pid 49948' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49948 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s open_pools_parallel 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' open_pools_parallel' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.154 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ echo open_pools_parallel 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.155 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49839/exe ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=open_pools_parallel 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49839/exe 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49991 2026-02-25T15:01:47.156 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test open_pools_parallel on pid 49991' 2026-02-25T15:01:47.157 INFO:tasks.workunit.client.0.trial072.stdout:test open_pools_parallel on pid 49991 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=49991 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s delete_pools_parallel 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' delete_pools_parallel' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ echo delete_pools_parallel 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.159 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49862/exe ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49862/exe 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.160 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_service.log 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_service: /' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=delete_pools_parallel 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50011 2026-02-25T15:01:47.161 INFO:tasks.workunit.client.0.trial072.stdout:test delete_pools_parallel on pid 50011 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test delete_pools_parallel on pid 50011' 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50011 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s cls 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.163 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' cls' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ echo cls 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.164 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49889/exe ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.165 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49889/exe 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=cls 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50046 2026-02-25T15:01:47.166 INFO:tasks.workunit.client.0.trial072.stdout:test cls on pid 50046 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test cls on pid 50046' 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50046 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-25T15:01:47.168 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s cmd 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' cmd' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ echo cmd 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.169 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49916/exe ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49916/exe 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.170 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=cmd 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50068 2026-02-25T15:01:47.171 INFO:tasks.workunit.client.0.trial072.stdout:test cmd on pid 50068 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test cmd on pid 50068' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50068 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s handler_error 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' handler_error' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ echo handler_error 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.174 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.175 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49948/exe ']' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=handler_error 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50097 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test handler_error on pid 50097' 2026-02-25T15:01:47.176 INFO:tasks.workunit.client.0.trial072.stdout:test handler_error on pid 50097 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50097 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s io 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49948/exe 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' io' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ echo io 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.179 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.180 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/49991/exe ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ list_parallel: /' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=io 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/49991/exe 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50122 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test io on pid 50122' 2026-02-25T15:01:47.181 INFO:tasks.workunit.client.0.trial072.stdout:test io on pid 50122 2026-02-25T15:01:47.183 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50122 2026-02-25T15:01:47.183 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.183 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.183 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-25T15:01:47.183 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s ec_io 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' ec_io' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ echo ec_io 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.184 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.185 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50011/exe ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=ec_io 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50152 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test ec_io on pid 50152' 2026-02-25T15:01:47.186 INFO:tasks.workunit.client.0.trial072.stdout:test ec_io on pid 50152 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50152 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50011/exe 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s list 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' list' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ echo list 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.188 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50046/exe ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.189 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50046/exe 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=list 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50168 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.190 INFO:tasks.workunit.client.0.trial072.stdout:test list on pid 50168 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test list on pid 50168' 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50168 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.192 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s ec_list 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' ec_list' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ echo ec_list 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.193 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.194 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_cls 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_cls.log 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ cls: /' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=ec_list 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50194 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test ec_list on pid 50194' 2026-02-25T15:01:47.195 INFO:tasks.workunit.client.0.trial072.stdout:test ec_list on pid 50194 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50194 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s misc 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' misc' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ echo misc 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.198 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50068/exe ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50068/exe 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.199 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.200 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50097/exe ']' 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=misc 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50097/exe 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50227 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test misc on pid 50227' 2026-02-25T15:01:47.201 INFO:tasks.workunit.client.0.trial072.stdout:test misc on pid 50227 2026-02-25T15:01:47.203 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50227 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s pool 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_cmd 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' pool' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ cmd: /' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ echo pool 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.204 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.205 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_handler_error 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ handler_error: /' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=pool 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50122/exe ']' 2026-02-25T15:01:47.206 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50122/exe 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50280 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test pool on pid 50280' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stdout:test pool on pid 50280 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50280 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.207 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [----------] Global test environment set-up. 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.099+0000 7fd03295c880 10 monclient: get_monmap_and_config 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.099+0000 7fd03295c880 10 monclient: build_initial_monmap 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.099+0000 7fd03295c880 10 monclient: monmap: 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 0.000000 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 0.000000 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 1 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.099+0000 7fd03295c880 1 Processor -- start 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 1 -- start start 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient: init 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient: _reopen_session rank -1 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-b con 0x55de70a21ef0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-c con 0x55de70a488b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-a con 0x55de70a6a3e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de7097b280 con 0x55de70a6a3e0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de70a09ad0 con 0x55de70a21ef0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de70a0acb0 con 0x55de70a488b0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient(hunting): _renew_subs 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.100+0000 7fd03295c880 10 monclient(hunting): authenticate will time out at 3052.835390s 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.111+0000 7fd02bfff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x55de70a21ef0 0x55de70a8a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.72:43668/0 (socket says 10.20.193.72:43668) 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.111+0000 7fd02bfff640 1 -- 10.20.193.72:0/1417857916 learned_addr learned my addr 10.20.193.72:0/1417857916 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154332321 0 0) 0x55de70a09ad0 con 0x55de70a21ef0 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.208 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 10 monclient(hunting): my global_id is 4702 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s read_operations 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' read_operations' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.211 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ echo read_operations 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.212 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_io 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_io.log 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ io: /' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50152/exe ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50152/exe 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.213 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50168/exe ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=read_operations 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50313 2026-02-25T15:01:47.214 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.123+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 --> v1:10.20.193.31:6test read_operations on pid 50313 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test read_operations on pid 50313' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50313 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50168/exe 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s snapshots 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' snapshots' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.217 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ echo snapshots 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_ec_io 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ ec_io: /' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.218 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_list 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_list.log 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.219 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ list: /' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=snapshots 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50365 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.220 INFO:tasks.workunit.client.0.trial072.stdout:test snapshots on pid 50365 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test snapshots on pid 50365' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50365 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50194/exe ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s watch_notify 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' watch_notify' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50194/exe 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ echo watch_notify 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.223 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.224 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_ec_list 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50227/exe ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50227/exe 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ ec_list: /' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=watch_notify 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50398 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test watch_notify on pid 50398' 2026-02-25T15:01:47.225 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-25T15:01:47.226 INFO:tasks.workunit.client.0.trial072.stdout:test watch_notify on pid 50398 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50398 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.227 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ printf %25s write_operations 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+ r=' write_operations' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ echo write_operations 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ awk '{print $1}' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.228 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_misc 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_misc.log 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ ff=write_operations 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50435 2026-02-25T15:01:47.229 INFO:tasks.workunit.client.0.trial072.stdout:test write_operations on pid 50435 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ echo 'test write_operations on pid 50435' 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ pids[$f]=50435 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ misc: /' 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ ret=0 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' 1 -eq 1 ']' 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:01:47.236 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49453 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49453 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50280/exe ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.237 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50280/exe 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -f /etc/bashrc ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+ . /etc/bashrc 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -z '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ BASHRCSOURCED=Y 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ shopt -q login_shell 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ umask 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' 0022 -eq 0 ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ SHELL=/bin/bash 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-25T15:01:47.238 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_pool 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_pool.log 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ pool: /' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.239 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50313/exe ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50313/exe 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'grep=grep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorls.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' '!' -t 0 ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ return 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ export S_COLORS=auto 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:+++ S_COLORS=auto 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.240 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_read_operations 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ read_operations: /' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.241 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50365/exe ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50365/exe 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.242 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_snapshots 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ snapshots: /' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ prefix=/usr 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset prefix 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/gawk.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/lang.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.243 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50398/exe ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/locale 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50398/exe 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_watch_notify 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++++ export LANG=en_US.UTF-8 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++++ LANG=en_US.UTF-8 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ watch_notify: /' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ LANG=en_US.UTF-8 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ unset LANG_backup config 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n '' ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' dumb = linux ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/less.sh 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ for i in /etc/profile.d/*.sh 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ '[' '' ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:++ . /etc/profile.d/which2.sh 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++ '[' -r /proc/50435/exe ']' 2026-02-25T15:01:47.244 INFO:tasks.workunit.client.0.trial072.stderr:+++++ readlink /proc/50435/exe 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:++++ basename /usr/bin/bash 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ SHELLNAME=bash 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ case "$SHELLNAME" in 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_declare='declare -f' 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ which_opt=-f 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ export which_declare 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+++ export -f which 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:++ unset i 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:++ unset -f pathmunge 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ export PATH 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ unset rc 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ ceph_test_neorados_write_operations 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stderr:+ sed 's/^/ write_operations: /' 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout:789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd018001e10 con 0x55de70a21ef0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533840399 0 0) 0x55de7097b280 con 0x55de70a6a3e0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): my global_id is 4707 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55de70a09ad0 con 0x55de70a6a3e0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585720110 0 0) 0x55de70a0acb0 con 0x55de70a488b0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 10 monclient(hunting): my global_id is 4706 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.135+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55de7097b280 con 0x55de70a488b0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584643187 0 0) 0x7fd018001e10 con 0x55de70a21ef0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 >> v1:10.20.193.68:6789/0 conn(0x55de70a488b0 legacy=0x55de70a68c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 >> v1:10.20.193.21:6789/0 conn(0x55de70a6a3e0 legacy=0x55de70a073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 monclient: found mon.noname-b 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:01:47.245 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de70a0be90 con 0x55de70a21ef0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd01c001690 con 0x55de70a21ef0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd02a7fc640 10 monclient: dump: 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd03295c880 5 monclient: authenticate success, global_id 4702 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.166+0000 7fd03295c880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd01c0018d0 con 0x55de70a21ef0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 1 -- 10.20.193.72:0/1417857916 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd01c001ce0 con 0x55de70a21ef0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd02a7fc640 10 monclient: dump: 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd03295c880 10 monclient: get_monmap_and_config success 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.216+0000 7fd03295c880 4 set_mon_vals no callback set 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: shutdown 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- 10.20.193.72:0/1417857916 >> v1:10.20.193.31:6789/0 conn(0x55de70a21ef0 legacy=0x55de70a8a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- 10.20.193.72:0/1417857916 shutdown_connections 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- 10.20.193.72:0/1417857916 >> 10.20.193.72:0/1417857916 conn(0x55de709ffa90 msgr2=0x55de70a26ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:47.246 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- 10.20.193.72:0/1417857916 shutdown_connections 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- 10.20.193.72:0/1417857916 wait complete. 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: build_initial_monmap 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: monmap: 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 0 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 0.000000 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 0.000000 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 1 2026-02-25T15:01:47.247 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 librados: starting msgr at 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 librados: starting objecter 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 Processor -- start 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- start start 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 librados: setting wanted keys 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 librados: calling monclient init 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: init 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: _reopen_session rank -1 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-a con 0x55de70a21ef0 addr v1:10.20.193.21:6789/0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-c con 0x55de70a488b0 addr v1:10.20.193.68:6789/0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient(hunting): picked mon.noname-b con 0x55de70a6a3e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de70a69f80 con 0x55de70a21ef0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de70a6a170 con 0x55de70a6a3e0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55de70a12890 con 0x55de70a488b0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient(hunting): _renew_subs 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.217+0000 7fd03295c880 10 monclient(hunting): authenticate will time out at 3052.952685s 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.257+0000 7fd02b7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x55de70a488b0 0x55de70a092a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.72:60584/0 (socket says 10.20.193.72:60584) 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.257+0000 7fd02b7fe640 1 -- 10.20.193.72:0/3203088183 learned_addr learned my addr 10.20.193.72:0/3203088183 (peer_addr_for_me v1:10.20.193.72:0/0) 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.259+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x55de70a488b0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.259+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.261+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x55de70a21ef0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.261+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.265+0000 7fd0297fa640 10 client.?.objecter ms_handle_connect 0x55de70a6a3e0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.265+0000 7fd0297fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.288+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952696585 0 0) 0x55de70a69f80 con 0x55de70a21ef0 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.288+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.291 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.288+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.288+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.288+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4818 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.289+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd018001b30 con 0x55de70a21ef0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876843486 0 0) 0x55de70a6a170 con 0x55de70a6a3e0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4816 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.295+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55de70a69f80 con 0x55de70a6a3e0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004614156 0 0) 0x55de70a12890 con 0x55de70a488b0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 10 monclient(hunting): _negotiate 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 10 monclient(hunting): my global_id is 4817 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.299+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55de70a6a170 con 0x55de70a488b0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1496278870 0 0) 0x7fd018001b30 con 0x55de70a21ef0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55de70a12890 con 0x55de70a21ef0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd01c0019f0 con 0x55de70a21ef0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.353 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.354 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.354 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.354 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.354 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.348+0000 7fd0297fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2214399045 0 0) 0x55de70a69f80 con 0x55de70a6a3e0 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd018001b30 con 0x55de70a6a3e0 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd024001cd0 con 0x55de70a6a3e0 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.351+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.412 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 869157671 0 0) 0x55de70a6a170 con 0x55de70a488b0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55de70a69f80 con 0x55de70a488b0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd020001940 con 0x55de70a488b0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.356+0000 7fd0297fa640 10 monclient(hunting): dump: 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2590405939 0 0) 0x55de70a69f80 con 0x55de70a488b0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.31:6789/0 conn(0x55de70a6a3e0 legacy=0x55de70a0f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6789/0 conn(0x55de70a21ef0 legacy=0x55de70a8a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 10 monclient: _finish_hunting 0 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 1 monclient: found mon.c 2026-02-25T15:01:47.413 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de70a13ac0 con 0x55de70a488b0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 10 monclient: _finish_auth 0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 10 monclient: _check_auth_tickets 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd0297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 5 monclient: authenticate success, global_id 4817 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 monclient: _renew_subs 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55de70a12ac0 con 0x55de70a488b0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 client.4817.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 monclient: _renew_subs 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55de70a12f90 con 0x55de70a488b0 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 1 librados: init done 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.410+0000 7fd03295c880 10 librados: wait_for_osdmap waiting 2026-02-25T15:01:47.699 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd020001ef0 con 0x55de70a488b0 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd0200035d0 con 0x55de70a488b0 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd0297fa640 10 monclient: dump: 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: epoch 1 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: election_strategy: 3 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.695+0000 7fd02a7fc640 4 set_mon_vals no callback set 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.696+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fd02001cab0 con 0x55de70a488b0 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.696+0000 7fd02bfff640 10 monclient: get_auth_request con 0x7fd018078d00 auth_method 0 2026-02-25T15:01:47.700 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.696+0000 7fd0297fa640 10 client.4817.objecter ms_handle_connect 0x7fd018078d00 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 233258501 0 0) 0x7fd0200942b0 con 0x55de70a488b0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_map(30..30 src has 1..30) 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map got epochs [30,30] > 0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map decoding full epoch 30 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd0297fa640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd03295c880 10 librados: wait_for_osdmap done waiting 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd03295c880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.697+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x55de70927da0 con 0x55de70a488b0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (unknown 1262516695 0 0) 0x7fd020059880 con 0x55de70a488b0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd0297fa640 10 monclient: handle_get_version_reply finishing 1 version 30 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd029ffb640 10 client.4817.objecter _get_latest_version latest 30, have it 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd03295c880 10 client.4817.objecter create_pool name=ceph_test_rados_api_asio 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd03295c880 10 client.4817.objecter pool_op_submit 1 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd03295c880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:47.852+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x55de708ac570 con 0x55de70a488b0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v31) ==== 43+0+0 (unknown 1429853602 0 0) 0x7fd02005dc10 con 0x55de70a488b0 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 pool_op_reply(tid 1 (0) Success v31) 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 client.4817.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v31) 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 client.4817.objecter have request 1 at 0x55de70a07a80 Op: create 2026-02-25T15:01:48.329 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 20 client.4817.objecter waiting for client to reach epoch 31 before calling back 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 client.4817.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 monclient: _renew_subs 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=31}) -- 0x55de70a69f80 con 0x55de70a488b0 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.221+0000 7fd0297fa640 10 client.4817.objecter done 2026-02-25T15:01:48.330 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== mon.2 v1:10.20.193.68:6789/0 11 ==== osd_map(31..31 src has 1..31) ==== 13374+0+0 (unknown 4128738049 0 0) 0x7fd020062890 con 0x55de70a488b0 2026-02-25T15:01:51.308 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_map(31..31 src has 1..31) 2026-02-25T15:01:51.308 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map got epochs [31,31] > 30 2026-02-25T15:01:51.308 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map decoding incremental epoch 31 2026-02-25T15:01:51.308 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd0297fa640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 10 librados: set snap read head -> 1 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 10 librados: writefull oid=exist nspace= 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a13280 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 31 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 2 osd.12 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 2 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 15 client.4817.objecter _send_op 2 to 34.1 on osd.12 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:2 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de70a14ca0 con 0x55de70a11d90 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:51.309 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.327+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.413+0000 7fd030c13640 10 monclient: get_auth_request con 0x55de70a11d90 auth_method 0 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:48.429+0000 7fd0297fa640 10 client.4817.objecter ms_handle_connect 0x55de70a11d90 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:50.217+0000 7fd013fff640 10 monclient: tick 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:50.217+0000 7fd013fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:50.217+0000 7fd013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:50.217+0000 7fd013fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.217+0000 7fd013fff640 10 monclient: tick 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.217+0000 7fd013fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.217+0000 7fd013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.305+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 1 ==== osd_map(32..32 src has 1..32) ==== 9876+0+0 (unknown 3772774338 0 0) 0x7fd024001fa0 con 0x55de70a11d90 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.305+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_map(32..32 src has 1..32) 2026-02-25T15:01:51.310 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.305+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map got epochs [32,32] > 31 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.305+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map decoding incremental epoch 32 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.306+0000 7fd0297fa640 10 client.4817.objecter checking op 2 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.306+0000 7fd0297fa640 20 client.4817.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.306+0000 7fd0297fa640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.306+0000 7fd0297fa640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:51.306+0000 7fd0297fa640 20 client.4817.objecter 2 34.d3a59201 osd.12 exist [writefull 0~5 in=5b] 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.217+0000 7fd013fff640 10 monclient: tick 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.217+0000 7fd013fff640 10 monclient: _check_auth_tickets 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.217+0000 7fd013fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 2 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 3325229556 0 0) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.257 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 2 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 2 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 15 client.4817.objecter _finish_op 2 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 2 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 librados: Objecter returned from writefull r=0 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a10870 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 32 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 3 osd.12 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 3 2026-02-25T15:01:52.258 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 15 client.4817.objecter _send_op 3 to 34.1 on osd.12 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:3 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55de70a13310 con 0x55de70a11d90 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a10e40 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 32 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 4 osd.3 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 4 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 15 client.4817.objecter _send_op 4 to 34.1 on osd.3 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:4 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55de70a16ea0 con 0x55de70a11460 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.254+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 3 ==== osd_map(33..34 src has 1..34) ==== 4049+0+0 (unknown 1935573647 0 0) 0x7fd0240048c0 con 0x55de70a11d90 2026-02-25T15:01:52.271 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_map(33..34 src has 1..34) 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map got epochs [33,34] > 32 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map decoding incremental epoch 33 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 10 client.4817.objecter checking op 4 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target epoch 33 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 10 client.4817.objecter checking op 3 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target epoch 33 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.272 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map decoding incremental epoch 34 2026-02-25T15:01:52.415 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 10 client.4817.objecter checking op 4 2026-02-25T15:01:52.415 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.415 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.415 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 10 client.4817.objecter checking op 3 2026-02-25T15:01:52.415 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter 4 34.a7bbaa1 osd.3 noexist [read 0~256] 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.268+0000 7fd0297fa640 20 client.4817.objecter 3 34.d3a59201 osd.12 exist [read 0~256] 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 3455087017 0 3741568377) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 3 ondisk uv 1 in 34.1 attempt 0 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 3 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 15 client.4817.objecter _finish_op 3 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 3 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.275+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.398+0000 7fd02bfff640 10 monclient: get_auth_request con 0x55de70a11460 auth_method 0 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.399+0000 7fd0297fa640 10 client.4817.objecter ms_handle_connect 0x55de70a11460 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.411+0000 7fd03269d640 10 client.4817.objecter tick 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.411+0000 7fd03269d640 20 client.4817.objecter tick: elapsed since last osdmap request 4.18996s, stale_window 10s, epoch 35, monc->get_start(osdmap) 0 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 1 ==== osd_map(33..34 src has 1..34) ==== 4049+0+0 (unknown 1935573647 0 0) 0x7fd01c004320 con 0x55de70a11460 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1512801648 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd0297fa640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_map(33..34 src has 1..34) 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd0297fa640 3 client.4817.objecter handle_osd_map ignoring epochs [33,34] <= 34 2026-02-25T15:01:52.416 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd0297fa640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd0297fa640 20 client.4817.objecter 4 34.a7bbaa1 osd.3 noexist [read 0~256] 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 4 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 15 client.4817.objecter handle_osd_op_reply completed tid 4 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 15 client.4817.objecter _finish_op 4 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 4 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd02bfff640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (158 ms) 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a10e40 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 5 osd.3 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 5 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 15 client.4817.objecter _send_op 5 to 34.1 on osd.3 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:5 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a10870 con 0x55de70a11460 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.417 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 6 osd.12 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 6 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 15 client.4817.objecter _send_op 6 to 34.1 on osd.12 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:6 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17820 con 0x55de70a11d90 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.413+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1512801648 0 0) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.420 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 6 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 6 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 15 client.4817.objecter _finish_op 6 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 6 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 3 ==== osd_op_reply(5 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2538435014 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(5 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 5 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.421 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 5 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a10e40 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 7 osd.12 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 7 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 15 client.4817.objecter _send_op 7 to 34.1 on osd.12 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:7 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a10870 con 0x55de70a11d90 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.418+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2032994016 0 3741568377) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.425 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 7 ondisk uv 1 in 34.1 attempt 1 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 7 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 15 client.4817.objecter _finish_op 7 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 7 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (9 ms) 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.426 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 8 osd.3 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 8 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 15 client.4817.objecter _send_op 8 to 34.1 on osd.3 2026-02-25T15:01:52.427 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:8 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17c50 con 0x55de70a11460 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a18320 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.422+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 9 osd.12 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 9 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 15 client.4817.objecter _send_op 9 to 34.1 on osd.12 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:9 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a187d0 con 0x55de70a11d90 2026-02-25T15:01:52.428 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.429 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.423+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.429 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 7 ==== osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1512801648 0 0) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.429 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.429 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.429 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 9 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 9 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 15 client.4817.objecter _finish_op 9 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 9 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.425+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 4 ==== osd_op_reply(8 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2538435014 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(8 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.455 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 8 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 8 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 10 osd.12 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 10 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 15 client.4817.objecter _send_op 10 to 34.1 on osd.12 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:10 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17c50 con 0x55de70a11d90 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.445+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.456 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 8 ==== osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2032994016 0 3741568377) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(10 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 10 ondisk uv 1 in 34.1 attempt 1 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 10 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 15 client.4817.objecter _finish_op 10 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 10 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.452+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (30 ms) 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 11 osd.3 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.457 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 11 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 15 client.4817.objecter _send_op 11 to 34.1 on osd.3 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:11 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a18300 con 0x55de70a11460 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a18d70 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 12 osd.12 2026-02-25T15:01:52.458 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 12 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 15 client.4817.objecter _send_op 12 to 34.1 on osd.12 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:12 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a19220 con 0x55de70a11d90 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.453+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 5 ==== osd_op_reply(11 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2538435014 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(11 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 11 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 11 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.459 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 13 osd.12 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 13 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 15 client.4817.objecter _send_op 13 to 34.1 on osd.12 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:13 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a18300 con 0x55de70a11d90 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd02bfff640 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 9 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1512801648 0 0) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.460 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 12 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 12 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 15 client.4817.objecter _finish_op 12 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 12 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.455+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 10 ==== osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2032994016 0 3741568377) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 13 ondisk uv 1 in 34.1 attempt 1 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 13 2026-02-25T15:01:52.461 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 15 client.4817.objecter _finish_op 13 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 13 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (5 ms) 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.462 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.465 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 14 osd.3 2026-02-25T15:01:52.465 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.465 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 14 2026-02-25T15:01:52.465 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 15 client.4817.objecter _send_op 14 to 34.1 on osd.3 2026-02-25T15:01:52.465 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:14 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a18d50 con 0x55de70a11460 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a19710 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~256] tid 15 osd.3 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 15 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 15 client.4817.objecter _send_op 15 to 34.1 on osd.3 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:15 34.1 34:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a19bc0 con 0x55de70a11460 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 5 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.458+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 6 ==== osd_op_reply(14 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2538435014 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(14 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 14 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.466 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 5 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 14 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a17370 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~256] tid 16 osd.12 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 16 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter _send_op 16 to 34.1 on osd.12 2026-02-25T15:01:52.468 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:16 34.1 34:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a19bc0 con 0x55de70a11d90 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 7 ==== osd_op_reply(15 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1512801648 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(15 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 15 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter handle_osd_op_reply completed tid 15 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter _finish_op 15 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 15 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.463+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 11 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2032994016 0 3741568377) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-25T15:01:52.469 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 16 ondisk uv 1 in 34.1 attempt 1 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 16 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 15 client.4817.objecter _finish_op 16 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 16 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (7 ms) 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a17370 write_seq 1 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1a720 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.489 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 17 osd.12 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 17 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 15 client.4817.objecter _send_op 17 to 34.1 on osd.12 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:17 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17480 con 0x55de70a11d90 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.466+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 12 ==== osd_op_reply(17 exist [write 0~5] v34'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 1212484401 0 0) 0x7fd0240045b0 con 0x55de70a11d90 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(17 exist [write 0~5] v34'2 uv2 ondisk = 0) 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 17 ondisk uv 2 in 34.1 attempt 0 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 17 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 15 client.4817.objecter _finish_op 17 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 17 2026-02-25T15:01:52.490 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a17370 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (20 ms) 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1abd0 write_seq 2 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1a720 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 18 osd.12 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 18 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 15 client.4817.objecter _send_op 18 to 34.1 on osd.12 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:18 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17480 con 0x55de70a11d90 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x55de70a11d90 legacy=0x55de70a12160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x55de70a11d90 legacy=0x55de70a12160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 1 --1- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x55de70a11d90 0x55de70a12160 :-1 s=OPENED pgs=9 cs=1 l=1).handle_message read tag failed 2026-02-25T15:01:52.491 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd030c13640 1 --1- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x55de70a11d90 0x55de70a12160 :-1 s=OPENED pgs=9 cs=1 l=1).fault on lossy channel, failing 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 1 client.4817.objecter ms_handle_reset 0x55de70a11d90 session 0x55de70a13730 osd.12 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 10 client.4817.objecter reopen_session osd.12 session, addr now v1:10.20.193.21:6808/3798667347 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x55de70a11d90 legacy=0x55de70a12160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 15 client.4817.objecter _send_op 18 to 34.1 on osd.12 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:18 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e34) -- 0x7fd0180a83c0 con 0x7fd0180b6c00 2026-02-25T15:01:52.508 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 10 client.4817.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 10 monclient: _renew_subs 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.487+0000 7fd0297fa640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=35}) -- 0x55de70a6a170 con 0x55de70a488b0 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.490+0000 7fd030c13640 10 monclient: get_auth_request con 0x7fd0180b6c00 auth_method 0 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.493+0000 7fd0297fa640 10 client.4817.objecter ms_handle_connect 0x7fd0180b6c00 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 1 ==== osd_op_reply(18 exist [write 0~5] v34'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 178086499 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(18 exist [write 0~5] v34'3 uv3 ondisk = 0) 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 18 ondisk uv 3 in 34.1 attempt 1 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 18 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 15 client.4817.objecter _finish_op 18 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 18 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1abd0 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (19 ms) 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1bd10 write_seq 3 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.509 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.520 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.520 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 19 osd.12 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 19 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 15 client.4817.objecter _send_op 19 to 34.1 on osd.12 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:19 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a17480 con 0x7fd0180b6c00 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.506+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 2 ==== osd_op_reply(19 exist [write 0~5] v34'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 1990911288 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(19 exist [write 0~5] v34'4 uv4 ondisk = 0) 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 19 ondisk uv 4 in 34.1 attempt 0 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 19 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 15 client.4817.objecter _finish_op 19 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 19 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1bd10 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (12 ms) 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a12610 write_seq 4 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.521 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.522 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 20 osd.12 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 20 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 15 client.4817.objecter _send_op 20 to 34.1 on osd.12 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:20 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x7fd0180b6c00 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.536 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.518+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 3 ==== osd_op_reply(20 exist [write 0~5] v34'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 36331244 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(20 exist [write 0~5] v34'5 uv5 ondisk = 0) 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 20 ondisk uv 5 in 34.1 attempt 0 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 20 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 15 client.4817.objecter _finish_op 20 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 20 2026-02-25T15:01:52.537 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a12610 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (15 ms) 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a203f0 write_seq 5 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.538 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.549 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [write 0~5 in=5b] tid 21 osd.12 2026-02-25T15:01:52.549 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.549 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 21 2026-02-25T15:01:52.549 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 15 client.4817.objecter _send_op 21 to 34.1 on osd.12 2026-02-25T15:01:52.549 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:21 34.1 34:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x7fd0180b6c00 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.533+0000 7fd03295c880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 4 ==== osd_op_reply(21 exist [write 0~5] v34'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 2678821520 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(21 exist [write 0~5] v34'6 uv6 ondisk = 0) 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 21 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 21 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 15 client.4817.objecter _finish_op 21 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 21 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (13 ms) 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a203f0 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.550 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.551 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.551 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 22 osd.12 2026-02-25T15:01:52.551 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.551 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 22 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 15 client.4817.objecter _send_op 22 to 34.1 on osd.12 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:22 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x7fd0180b6c00 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1ad00 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.554 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 23 osd.12 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 23 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 15 client.4817.objecter _send_op 23 to 34.1 on osd.12 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:23 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b1b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.547+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 5 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2340662674 0 3741568377) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 22 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.555 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 22 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter _finish_op 22 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 22 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 6 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 933477192 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (4 ms) 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 23 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 23 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter _finish_op 23 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 23 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.556 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 24 osd.3 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 24 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 15 client.4817.objecter _send_op 24 to 34.1 on osd.3 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:24 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x55de70a11460 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1ace0 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 25 osd.12 2026-02-25T15:01:52.557 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 25 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 15 client.4817.objecter _send_op 25 to 34.1 on osd.12 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:25 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b190 con 0x7fd0180b6c00 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.552+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 7 ==== osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 933477192 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 25 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 25 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 15 client.4817.objecter _finish_op 25 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 25 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 8 ==== osd_op_reply(24 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 4207235070 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(24 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.558 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 24 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 24 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 26 osd.12 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 26 2026-02-25T15:01:52.559 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 15 client.4817.objecter _send_op 26 to 34.1 on osd.12 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:26 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x7fd0180b6c00 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.554+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 8 ==== osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1063181019 0 3741568377) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 26 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 26 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 15 client.4817.objecter _finish_op 26 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 26 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (5 ms) 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.560 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 27 osd.3 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 27 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 15 client.4817.objecter _send_op 27 to 34.1 on osd.3 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:27 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ffe0 con 0x55de70a11460 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b5d0 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.563 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 28 osd.3 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 28 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 15 client.4817.objecter _send_op 28 to 34.1 on osd.3 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:28 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ace0 con 0x55de70a11460 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 5 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.557+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 9 ==== osd_op_reply(27 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 4207235070 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(27 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.564 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 27 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 5 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 27 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 29 osd.12 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 29 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter _send_op 29 to 34.1 on osd.12 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:29 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1ace0 con 0x7fd0180b6c00 2026-02-25T15:01:52.566 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 10 ==== osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 933477192 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(28 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 28 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter handle_osd_op_reply completed tid 28 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter _finish_op 28 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 28 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.561+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 9 ==== osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1063181019 0 3741568377) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 29 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 29 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 15 client.4817.objecter _finish_op 29 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 29 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.567 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 30 osd.12 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 30 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 15 client.4817.objecter _send_op 30 to 34.1 on osd.12 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:30 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b580 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.568 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 31 osd.3 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 31 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 15 client.4817.objecter _send_op 31 to 34.1 on osd.3 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:31 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70b95ff0 con 0x55de70a11460 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.564+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 11 ==== osd_op_reply(31 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 933477192 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(31 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 31 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 15 client.4817.objecter handle_osd_op_reply completed tid 31 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 15 client.4817.objecter _finish_op 31 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 31 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.566+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 10 ==== osd_op_reply(30 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 2340662674 0 3741568377) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(30 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.569 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 30 ondisk uv 6 in 34.1 attempt 0 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 30 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 15 client.4817.objecter _finish_op 30 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 30 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (2 ms) 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 32 osd.3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 32 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 15 client.4817.objecter _send_op 32 to 34.1 on osd.3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:32 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x55de70a11460 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b4c0 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [read 0~0] tid 33 osd.12 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 33 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 15 client.4817.objecter _send_op 33 to 34.1 on osd.12 2026-02-25T15:01:52.570 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:33 34.1 34:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b970 con 0x7fd0180b6c00 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.567+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 11 ==== osd_op_reply(33 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 933477192 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(33 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 33 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 33 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 15 client.4817.objecter _finish_op 33 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 33 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.568+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 12 ==== osd_op_reply(32 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 4207235070 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(32 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 32 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 7 client.4817.objecter got -EAGAIN, resubmitting 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 15 client.4817.objecter _session_op_remove 3 32 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.571 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 10 client.4817.objecter _op_submit oid exist '@34' '@34' [read 0~0] tid 34 osd.12 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.572 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 15 client.4817.objecter _session_op_assign 12 34 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 15 client.4817.objecter _send_op 34 to 34.1 on osd.12 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:34 34.1 34:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.569+0000 7fd02bfff640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 12 ==== osd_op_reply(34 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1063181019 0 3741568377) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(34 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 34 ondisk uv 6 in 34.1 attempt 1 2026-02-25T15:01:52.574 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 5 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 34 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 15 client.4817.objecter _finish_op 34 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 34 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (5 ms) 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1aef0 write_seq 6 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 35 osd.12 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 35 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 15 client.4817.objecter _send_op 35 to 34.1 on osd.12 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:35 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.575 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.572+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 13 ==== osd_op_reply(35 exist [writefull 0~5] v34'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 1981587408 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(35 exist [writefull 0~5] v34'7 uv7 ondisk = 0) 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 35 ondisk uv 7 in 34.1 attempt 0 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.611 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 35 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 15 client.4817.objecter _finish_op 35 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 35 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1aef0 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (24 ms) 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1b4c0 write_seq 7 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 36 osd.12 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 36 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 15 client.4817.objecter _send_op 36 to 34.1 on osd.12 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:36 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.596+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.612 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 14 ==== osd_op_reply(36 exist [writefull 0~5] v34'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 2520944574 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(36 exist [writefull 0~5] v34'8 uv8 ondisk = 0) 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 36 ondisk uv 8 in 34.1 attempt 0 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 36 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 15 client.4817.objecter _finish_op 36 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 36 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (12 ms) 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1b4c0 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1aef0 write_seq 8 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 37 osd.12 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 37 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 15 client.4817.objecter _send_op 37 to 34.1 on osd.12 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:37 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.609+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.625 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 15 ==== osd_op_reply(37 exist [writefull 0~5] v34'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 3804378218 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.626 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(37 exist [writefull 0~5] v34'9 uv9 ondisk = 0) 2026-02-25T15:01:52.626 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.626 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 37 ondisk uv 9 in 34.1 attempt 0 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 37 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 15 client.4817.objecter _finish_op 37 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.622+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 37 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.638 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1aef0 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (13 ms) 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1b550 write_seq 9 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 38 osd.12 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 38 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 15 client.4817.objecter _send_op 38 to 34.1 on osd.12 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:38 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.623+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 16 ==== osd_op_reply(38 exist [writefull 0~5] v34'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 2135160854 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(38 exist [writefull 0~5] v34'10 uv10 ondisk = 0) 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 38 ondisk uv 10 in 34.1 attempt 0 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 38 2026-02-25T15:01:52.639 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 15 client.4817.objecter _finish_op 38 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 38 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (13 ms) 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1b550 2026-02-25T15:01:52.651 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70a1aef0 write_seq 10 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a12160 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [writefull 0~5 in=5b] tid 39 osd.12 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 39 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 15 client.4817.objecter _send_op 39 to 34.1 on osd.12 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:39 34.1 34:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.636+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 17 ==== osd_op_reply(39 exist [writefull 0~5] v34'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 197346242 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(39 exist [writefull 0~5] v34'11 uv11 ondisk = 0) 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 39 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 39 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 15 client.4817.objecter _finish_op 39 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 39 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70a1aef0 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (12 ms) 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70a12160 linger_id 1 cookie 94413860708704 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.652 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 1 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter send_linger 1 register 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [notify cookie 94413860708704 in=17b] tid 40 osd.12 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 40 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _send_op 40 to 34.1 on osd.12 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:40 34.1 34:8049a5cb:::exist:head [notify cookie 94413860708704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70a1b120 con 0x7fd0180b6c00 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70b380f0 linger_id 2 cookie 94413861912816 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.653 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 2 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter send_linger 2 register 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70b39530 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94413861912816 in=17b] tid 41 osd.12 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 41 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 15 client.4817.objecter _send_op 41 to 34.1 on osd.12 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:41 34.1 34:855dde50:::noexist:head [notify cookie 94413861912816 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b399e0 con 0x7fd0180b6c00 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.649+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 18 ==== watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888064 ret 0) ==== 42+0+8 (unknown 3866357104 0 0) 0x7fd018001b30 con 0x7fd0180b6c00 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888064 ret 0) 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 19 ==== osd_op_reply(40 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2847654109 0 1749169930) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(40 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 40 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.666 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 8 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 40 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter _finish_op 40 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 40 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70a12160), ec = system:0 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 20 ==== osd_op_reply(41 noexist [notify cookie 94413861912816] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2341184405 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(41 noexist [notify cookie 94413861912816] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 41 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 41 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter _finish_op 41 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 41 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 10 client.4817.objecter _linger_commit 1 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 10 client.4817.objecter _linger_commit notify_id=146028888064 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 2 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 10 librados: finish linger op 0x55de70a12160 acked (0) 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 20 client.4817.objecter _linger_cancel linger_id=1 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 15 client.4817.objecter _session_linger_op_remove 12 1 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70b380f0 acked (-2) 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 10 librados: operator() completed notify (linger op 0x55de70b380f0), ec = osd:2 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 20 client.4817.objecter _linger_cancel linger_id=2 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd029ffb640 15 client.4817.objecter _session_linger_op_remove 12 2 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (14 ms) 2026-02-25T15:01:52.667 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70a12160 linger_id 3 cookie 94413860708704 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 3 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter send_linger 3 register 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [notify cookie 94413860708704 in=17b] tid 42 osd.12 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 42 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _send_op 42 to 34.1 on osd.12 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:42 34.1 34:8049a5cb:::exist:head [notify cookie 94413860708704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b37fe0 con 0x7fd0180b6c00 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70b393e0 linger_id 4 cookie 94413861917664 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 4 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter send_linger 4 register 2026-02-25T15:01:52.668 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70b39890 2026-02-25T15:01:52.669 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.669 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.669 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94413861917664 in=17b] tid 43 osd.12 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 43 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 15 client.4817.objecter _send_op 43 to 34.1 on osd.12 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:43 34.1 34:855dde50:::noexist:head [notify cookie 94413861917664 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x7fd0180b6c00 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.664+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 21 ==== watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888065 ret 0) ==== 42+0+8 (unknown 1547448318 0 0) 0x7fd018001b30 con 0x7fd0180b6c00 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888065 ret 0) 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70a12160), ec = system:0 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 22 ==== osd_op_reply(42 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2847654109 0 561924653) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(42 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 42 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 8 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 42 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 15 client.4817.objecter _finish_op 42 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 42 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 10 client.4817.objecter _linger_commit 3 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 10 client.4817.objecter _linger_commit notify_id=146028888065 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 10 librados: finish linger op 0x55de70a12160 acked (0) 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 20 client.4817.objecter _linger_cancel linger_id=3 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.667+0000 7fd029ffb640 15 client.4817.objecter _session_linger_op_remove 12 3 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 23 ==== osd_op_reply(43 noexist [notify cookie 94413861917664] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1605008260 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.671 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(43 noexist [notify cookie 94413861917664] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 43 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 43 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 15 client.4817.objecter _finish_op 43 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 43 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 4 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70b393e0 acked (-2) 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70b393e0), ec = osd:2 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 20 client.4817.objecter _linger_cancel linger_id=4 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd02a7fc640 15 client.4817.objecter _session_linger_op_remove 12 4 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (4 ms) 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70a12160 linger_id 5 cookie 94413860708704 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 5 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter send_linger 5 register 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.672 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [notify cookie 94413860708704 in=17b] tid 44 osd.12 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 44 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _send_op 44 to 34.1 on osd.12 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:44 34.1 34:8049a5cb:::exist:head [notify cookie 94413860708704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x7fd0180b6c00 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70b393e0 linger_id 6 cookie 94413861917664 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 6 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter send_linger 6 register 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70b39850 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94413861917664 in=17b] tid 45 osd.12 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 45 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 15 client.4817.objecter _send_op 45 to 34.1 on osd.12 2026-02-25T15:01:52.673 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:45 34.1 34:855dde50:::noexist:head [notify cookie 94413861917664 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x7fd0180b6c00 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.668+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 24 ==== watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888066 ret 0) ==== 42+0+8 (unknown 2533367453 0 0) 0x7fd018001b30 con 0x7fd0180b6c00 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888066 ret 0) 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd029ffb640 10 librados: operator() completed notify (linger op 0x55de70a12160), ec = system:0 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 25 ==== osd_op_reply(44 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2847654109 0 4198157636) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(44 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 44 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 8 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 44 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 15 client.4817.objecter _finish_op 44 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 44 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 5 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit notify_id=146028888066 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70a12160 acked (0) 2026-02-25T15:01:52.676 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 20 client.4817.objecter _linger_cancel linger_id=5 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.672+0000 7fd02a7fc640 15 client.4817.objecter _session_linger_op_remove 12 5 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 26 ==== osd_op_reply(45 noexist [notify cookie 94413861917664] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1605008260 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(45 noexist [notify cookie 94413861917664] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 45 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 45 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 15 client.4817.objecter _finish_op 45 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 45 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 10 client.4817.objecter _linger_commit 6 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 10 librados: finish linger op 0x55de70b393e0 acked (-2) 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 10 librados: operator() completed notify (linger op 0x55de70b393e0), ec = osd:2 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 20 client.4817.objecter _linger_cancel linger_id=6 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd029ffb640 15 client.4817.objecter _session_linger_op_remove 12 6 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (5 ms) 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70a12160 linger_id 7 cookie 94413860708704 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 7 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter send_linger 7 register 2026-02-25T15:01:52.677 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [notify cookie 94413860708704 in=17b] tid 46 osd.12 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 46 2026-02-25T15:01:52.678 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _send_op 46 to 34.1 on osd.12 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:46 34.1 34:8049a5cb:::exist:head [notify cookie 94413860708704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x7fd0180b6c00 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70b39400 linger_id 8 cookie 94413861917696 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 8 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter send_linger 8 register 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70b39830 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94413861917696 in=17b] tid 47 osd.12 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 47 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 15 client.4817.objecter _send_op 47 to 34.1 on osd.12 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:47 34.1 34:855dde50:::noexist:head [notify cookie 94413861917696 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b37010 con 0x7fd0180b6c00 2026-02-25T15:01:52.681 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.674+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.678+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 27 ==== watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888067 ret 0) ==== 42+0+8 (unknown 760208403 0 0) 0x7fd018001b30 con 0x7fd0180b6c00 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.678+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888067 ret 0) 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 28 ==== osd_op_reply(46 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2847654109 0 3003560035) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(46 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 46 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 8 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 46 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter _finish_op 46 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 46 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70a12160), ec = system:0 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 7 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 29 ==== osd_op_reply(47 noexist [notify cookie 94413861917696] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 543322730 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit notify_id=146028888067 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(47 noexist [notify cookie 94413861917696] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 47 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 47 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter _finish_op 47 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70a12160 acked (0) 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 47 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 8 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd029ffb640 20 client.4817.objecter _linger_cancel linger_id=7 2026-02-25T15:01:52.682 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd029ffb640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd029ffb640 15 client.4817.objecter _session_linger_op_remove 12 7 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70b39400 acked (-2) 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70b39400), ec = osd:2 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 20 client.4817.objecter _linger_cancel linger_id=8 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (4 ms) 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd02a7fc640 15 client.4817.objecter _session_linger_op_remove 12 8 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70a12160 linger_id 9 cookie 94413860708704 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.d3a59201 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 9 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter send_linger 9 register 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base exist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target target exist @34 -> pgid 34.d3a59201 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _op_submit oid exist '@34' '@34' [notify cookie 94413860708704 in=17b] tid 48 osd.12 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 48 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _send_op 48 to 34.1 on osd.12 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:48 34.1 34:8049a5cb:::exist:head [notify cookie 94413860708704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x7fd0180b6c00 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter linger_register info 0x55de70b394f0 linger_id 10 cookie 94413861917936 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.683 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _session_linger_op_assign 12 10 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter send_linger 10 register 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70b36fd0 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [notify cookie 94413861917936 in=17b] tid 49 osd.12 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 6 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 49 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 15 client.4817.objecter _send_op 49 to 34.1 on osd.12 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:49 34.1 34:855dde50:::noexist:head [notify cookie 94413861917936 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55de70b37480 con 0x7fd0180b6c00 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.679+0000 7fd03295c880 5 client.4817.objecter 2 in flight 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 30 ==== watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888068 ret 0) ==== 42+0+8 (unknown 76810922 0 0) 0x7fd018001b30 con 0x7fd0180b6c00 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 watch-notify(notify_complete (2) cookie 94413860708704 notify 146028888068 ret 0) 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd029ffb640 10 librados: operator() completed notify (linger op 0x55de70a12160), ec = system:0 2026-02-25T15:01:52.685 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 31 ==== osd_op_reply(48 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2847654109 0 1231009127) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(48 exist [notify cookie 94413860708704 out=8b] v0'0 uv11 ondisk = 0) 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 48 ondisk uv 11 in 34.1 attempt 0 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 8 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 48 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 15 client.4817.objecter _finish_op 48 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 7 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 48 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd030c13640 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit 9 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 10 client.4817.objecter _linger_commit notify_id=146028888068 2026-02-25T15:01:52.686 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 10 librados: finish linger op 0x55de70a12160 acked (0) 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 20 client.4817.objecter _linger_cancel linger_id=9 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.683+0000 7fd02a7fc640 15 client.4817.objecter _session_linger_op_remove 12 9 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 32 ==== osd_op_reply(49 noexist [notify cookie 94413861917936] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 994121816 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(49 noexist [notify cookie 94413861917936] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 49 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 10 client.4817.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 49 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 15 client.4817.objecter _finish_op 49 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 5 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 49 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd029ffb640 10 client.4817.objecter _linger_commit 10 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd029ffb640 10 librados: finish linger op 0x55de70b394f0 acked (-2) 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd02a7fc640 10 librados: operator() completed notify (linger op 0x55de70b394f0), ec = osd:2 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd02a7fc640 20 client.4817.objecter _linger_cancel linger_id=10 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd02a7fc640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd02a7fc640 15 client.4817.objecter _session_linger_op_remove 12 10 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (5 ms) 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter chose random osd.3 of [12,3] 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [stat] tid 50 osd.3 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.687 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 3 50 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _send_op 50 to 34.1 on osd.3 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.72:6805/464837367 -- osd_op(unknown.0.0:50 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70b3ae70 con 0x55de70a11460 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 4 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter _op_cancel: cancelling tid 50 r=-125 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter op_cancel tid 50 in session 3 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _finish_op 50 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 3 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_remove 3 50 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_read 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter chose random osd.12 of [12,3] 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [stat] tid 51 osd.12 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 51 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _send_op 51 to 34.1 on osd.12 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:51 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x55de70a12160 con 0x7fd0180b6c00 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter _op_cancel: cancelling tid 51 r=-125 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter op_cancel tid 51 in session 12 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _finish_op 51 2026-02-25T15:01:52.688 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_remove 12 51 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70b39b30 write_seq 11 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [stat] tid 52 osd.12 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 52 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _send_op 52 to 34.1 on osd.12 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:52 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a12160 con 0x7fd0180b6c00 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter _op_cancel: cancelling tid 52 r=-125 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter op_cancel tid 52 in session 12 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 librados: complete_aio_write 0x55de70b39b30 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _finish_op 52 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_remove 12 52 2026-02-25T15:01:52.689 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 librados: queue_aio_write 0x55de708d2390 completion 0x55de70b39b30 write_seq 12 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit op 0x55de70a1b6d0 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target epoch 34 base noexist @34 precalc_pgid 0 pgid 0.0 is_write 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _calc_target target noexist @34 -> pgid 34.a7bbaa1 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _calc_target raw pgid 34.a7bbaa1 -> actual 34.1 acting [12,3] primary 12 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter _get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 10 client.4817.objecter _op_submit oid noexist '@34' '@34' [stat] tid 53 osd.12 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter get_session s=0x55de70a13730 osd=12 3 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _session_op_assign 12 53 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 15 client.4817.objecter _send_op 53 to 34.1 on osd.12 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 --> v1:10.20.193.21:6808/3798667347 -- osd_op(unknown.0.0:53 34.1 34:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55de70a12160 con 0x7fd0180b6c00 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.684+0000 7fd03295c880 5 client.4817.objecter 1 in flight 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.687+0000 7fd02bfff640 1 -- 10.20.193.72:0/3203088183 <== osd.3 v1:10.20.193.72:6805/464837367 13 ==== osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2861829596 0 0) 0x7fd01c004660 con 0x55de70a11460 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.687+0000 7fd02bfff640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.687+0000 7fd02bfff640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.687+0000 7fd02bfff640 7 client.4817.objecter handle_osd_op_reply 50 ondisk ... stray 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.689+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 33 ==== osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2861829596 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.689+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.689+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.689+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 51 ondisk ... stray 2026-02-25T15:01:52.695 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 34 ==== osd_op_reply(52 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 540508569 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(52 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 52 ondisk ... stray 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 <== osd.12 v1:10.20.193.21:6808/3798667347 35 ==== osd_op_reply(53 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 540508569 0 0) 0x7fd0240045b0 con 0x7fd0180b6c00 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 10 client.4817.objecter ms_dispatch2 0x55de708ee590 osd_op_reply(53 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 10 client.4817.objecter in handle_osd_op_reply 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 7 client.4817.objecter handle_osd_op_reply 53 ondisk uv 0 in 34.1 attempt 0 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 10 client.4817.objecter op 0 rval 0 len 0 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 15 client.4817.objecter handle_osd_op_reply completed tid 53 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 15 client.4817.objecter _finish_op 53 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 4 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 15 client.4817.objecter _session_op_remove 12 53 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 5 client.4817.objecter 0 in flight 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 20 librados: complete_aio_write 0x55de70b39b30 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (8 ms) 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 librados: watch_flush enter 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 librados: watch_flush exit 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 client.4817.objecter close_session for osd.3 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.72:6805/464837367 conn(0x55de70a11460 legacy=0x55de70a155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a112f0 osd=3 1 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 client.4817.objecter close_session for osd.12 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.21:6808/3798667347 conn(0x7fd0180b6c00 legacy=0x7fd0180b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 20 client.4817.objecter put_session s=0x55de70a13730 osd=12 1 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 20 client.4817.objecter shutdown clearing up homeless session... 2026-02-25T15:01:52.696 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 client.4817.objecter successfully canceled tick 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.72:6800/2463505645 conn(0x7fd018078d00 legacy=0x7fd0180991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 10 monclient: shutdown 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 >> v1:10.20.193.68:6789/0 conn(0x55de70a488b0 legacy=0x55de70a092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 reap_dead start 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd030c13640 1 -- 10.20.193.72:0/3203088183 reap_dead start 2026-02-25T15:01:52.697 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 shutdown_connections 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 >> 10.20.193.72:0/3203088183 conn(0x55de709ffa90 msgr2=0x55de70a26b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 shutdown_connections 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 -- 10.20.193.72:0/3203088183 wait complete. 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.693+0000 7fd03295c880 1 librados: shutdown 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [----------] 29 tests from AsioRados (438 ms total) 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [----------] Global test environment tear-down 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (5593 ms total) 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49590 2026-02-25T15:01:52.698 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49590 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: Running main() from gmock_main.cc 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [----------] Global test environment set-up. 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [ OK ] NeoRadosCls.DNE (7347 ms) 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [----------] 1 test from NeoRadosCls (7347 ms total) 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [----------] Global test environment tear-down 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [==========] 1 test from 1 test suite ran. (7347 ms total) 2026-02-25T15:01:54.475 INFO:tasks.workunit.client.0.trial072.stdout: cls: [ PASSED ] 1 test. 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (640 ms) 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (35 ms) 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (7558 ms) 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (8235 ms total) 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: 2026-02-25T15:01:55.342 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-25T15:01:55.343 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (8235 ms total) 2026-02-25T15:01:55.343 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: Running main() from gmock_main.cc 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [----------] Global test environment set-up. 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (8221 ms) 2026-02-25T15:01:55.356 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [----------] 1 test from neocls_handler_error (8221 ms total) 2026-02-25T15:01:55.357 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: 2026-02-25T15:01:55.357 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [----------] Global test environment tear-down 2026-02-25T15:01:55.357 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [==========] 1 test from 1 test suite ran. (8221 ms total) 2026-02-25T15:01:55.357 INFO:tasks.workunit.client.0.trial072.stdout: handler_error: [ PASSED ] 1 test. 2026-02-25T15:01:56.357 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: Running main() from gmock_main.cc 2026-02-25T15:01:56.357 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-25T15:01:56.357 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-25T15:01:56.357 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-25T15:01:56.357 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (2977 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (51 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (420 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (252 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (97 ms) 2026-02-25T15:01:56.358 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (70 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (85 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (77 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (71 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (57 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (85 ms) 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-25T15:01:56.359 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (51 ms) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (228 ms) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (176 ms) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (94 ms) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (613 ms) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (5412 ms total) 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-25T15:01:56.360 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (9240 ms total) 2026-02-25T15:01:56.361 INFO:tasks.workunit.client.0.trial072.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-25T15:01:56.612 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-25T15:01:56.612 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:01:56.612 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-25T15:01:56.612 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-25T15:01:56.612 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (784 ms) 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (33 ms) 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7483 ms) 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:53.844847+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/3691460204' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial072-50321-1"}]': finished 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:53.846370+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/522148959' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial072-49482-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:53.847390+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/3576186942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial072-49711-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:56.613 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:54.142336+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/3691460204' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial072-50321-1"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.153157+0000 mon.c [INF] from='client.4936 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial072-49501-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.155552+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/3691460204' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritetrial072-50321-1"}]': finished 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.331599+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2748640368' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-50057-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.399894+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/2153617246' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial072-50321-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.446054+0000 mon.c [INF] from='client.5035 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial072-50321-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.479137+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/3590698137' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.540738+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.589557+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/3590698137' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.618232+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.650456+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/3590698137' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial072-49786-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.696431+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial072-49852-7"} : dispatch 2026-02-25T15:01:56.614 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.722082+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial072-49852-7"} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.731152+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/1010455376' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.732807+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial072-49852-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.753407+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial072-49786-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.775795+0000 client.admin [INF] onexx 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:55.780895+0000 mon.c [INF] from='client.5022 ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.219409+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2748640368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial072-50057-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.221263+0000 mon.c [INF] from='client.5035 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial072-50321-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.222336+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial072-49852-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.223271+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial072-49786-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.298314+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial072-49852-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial072-49852-7"} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.336850+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/1508892377' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-49711-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:56.615 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.340561+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/2153617246' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial072-50321-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial072-50321-2"} : dispatch 2026-02-25T15:01:58.588 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.344501+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/3590698137' api_service: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:01:58.589 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [----------] Global test environment set-up. 2026-02-25T15:01:58.589 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-25T15:01:58.589 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-25T15:01:58.589 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5304 ms) 2026-02-25T15:01:58.589 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ OK ] LibRadosService.RegisterLate (523 ms) 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: cluster: 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: id: 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: health: HEALTH_OK 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: services: 2026-02-25T15:01:58.590 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 81s) [leader: c] 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mgr: x(active, since 78s), standbys: y 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: osd: 16 osds: 16 up (since 48s), 16 in (since 74s) 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: data: 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pools: 32 pools, 969 pgs 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: objects: 4 objects, 449 KiB 2026-02-25T15:01:58.591 INFO:tasks.workunit.client.0.trial072.stdout: api_service: usage: 427 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pgs: 99.071% pgs unknown 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 960 unknown 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 9 active+clean 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: cluster: 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: id: 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:58.592 INFO:tasks.workunit.client.0.trial072.stdout: api_service: health: HEALTH_OK 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: services: 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 83s) [leader: c] 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mgr: x(active, since 80s), standbys: y 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: osd: 16 osds: 16 up (since 50s), 16 in (since 76s) 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: foo: 15 portals active (1 hosts, 3 zones) 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-25T15:01:58.593 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: data: 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pools: 35 pools, 1017 pgs 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: objects: 31 objects, 451 KiB 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: usage: 429 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pgs: 6.686% pgs unknown 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 12.291% pgs not active 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 824 active+clean 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 73 creating+peering 2026-02-25T15:01:58.594 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 68 unknown 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 52 creating+activating 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: io: 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: client: 369 B/s rd, 3.6 KiB/s wr, 1 op/s rd, 4 op/s wr 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: cluster: 2026-02-25T15:01:58.595 INFO:tasks.workunit.client.0.trial072.stdout: api_service: id: 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: health: HEALTH_OK 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: services: 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 86s) [leader: c] 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: mgr: x(active, since 82s), standbys: y 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: osd: 16 osds: 16 up (since 52s), 16 in (since 78s) 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-25T15:01:58.596 INFO:tasks.workunit.client.0.trial072.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: data: 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pools: 25 pools, 697 pgs 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: objects: 20 objects, 450 KiB 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: usage: 429 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: pgs: 33.429% pgs unknown 2026-02-25T15:01:58.597 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 8.321% pgs not active 2026-02-25T15:01:59.618 INFO:tasks.workunit.client.0.trial072.stdout: api_service: entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial072-49786-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:59.618 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.355890+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/3682763984' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial072-49501-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.618 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.356685+0000 mon.c [INF] from='client.5035 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial072-50321-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial072-50321-2"} : dispatch 2026-02-25T15:01:59.618 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.367443+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial072-49786-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial072-49786-7"} : dispatch 2026-02-25T15:01:59.618 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.380310+0000 mon.c [INF] from='client.4936 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial072-49501-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:56.390681+0000 mon.c [INF] from='client.4992 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-49711-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:57.572275+0000 mon.c [INF] from='client.5022 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.321889+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/2055240155' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial072-49852-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial072-49852-7"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.322945+0000 mon.c [INF] from='client.5035 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOptrial072-50321-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial072-50321-2"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.324046+0000 mon.c [INF] from='client.5077 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_trial072-49786-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial072-49786-7"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.324993+0000 mon.c [INF] from='client.4857 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial072-50391-1"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.325768+0000 mon.c [INF] from='client.4821 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial072-49907-1"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.326572+0000 mon.c [INF] from='client.4936 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial072-49501-3", "field": "max_bytes", "val": "4096"}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.327501+0000 mon.c [INF] from='client.5134 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial072-49632-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:01:59.619 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.423476+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/3087429866' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial072-50391-1"} : dispatch 2026-02-25T15:01:59.775 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.424983+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/2719262464' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial072-49907-1"} : dispatch 2026-02-25T15:01:59.775 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.454300+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/432578441' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-50057-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.775 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.460966+0000 mon.c [INF] from='client.4857 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial072-50391-1"} : dispatch 2026-02-25T15:01:59.775 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.468823+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1002353760' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial072-49632-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial072-49632-10"} : dispatch 2026-02-25T15:01:59.775 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.471016+0000 mon.c [INF] from='client.4821 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial072-49907-1"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.474825+0000 mon.c [INF] from='client.5043 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-50057-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.509203+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1913288300' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial072-49482-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.548398+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1088815666' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.550124+0000 mon.c [INF] from='client.5134 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial072-49632-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial072-49632-10"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.565247+0000 mon.c [INF] from='client.5113 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial072-49482-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.593975+0000 mon.c [INF] from='client.5149 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.623666+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1088815666' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.705185+0000 mon.c [INF] from='client.5149 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.711286+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1088815666' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial072-49525-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:58.796246+0000 mon.c [INF] from='client.5149 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial072-49525-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:59.776 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.374703+0000 mon.c [INF] from='client.4857 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectstrial072-50391-1"}]': finished 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.375817+0000 mon.c [INF] from='client.4821 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial072-49907-1"}]': finished 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.376660+0000 mon.c [INF] from='client.5043 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial072-50057-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.377562+0000 mon.c [INF] from='client.5113 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial072-49482-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.378506+0000 mon.c [INF] from='client.5149 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial072-49525-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.492286+0000 mon.b [INF] from='client.? v1:10.20.193.72:0/1088815666' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial072-49525-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.497794+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/1770074921' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-49711-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.509156+0000 mon.c [INF] from='client.5149 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial072-49525-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial072-49525-16"} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.520141+0000 mon.c [INF] from='client.? v1:10.20.193.72:0/1657193196' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial072-50391-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.526992+0000 mon.c [INF] from='client.5091 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial072-49711-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.546518+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/2628569396' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial072-49598-10"} : dispatch 2026-02-25T15:01:59.777 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.558863+0000 mon.c [INF] from='client.5121 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial072-49598-10"} : dispatch 2026-02-25T15:01:59.778 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.571903+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/2628569396' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial072-49598-10"} : dispatch 2026-02-25T15:01:59.778 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.577269+0000 mon.c [INF] from='client.5121 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial072-49598-10"} : dispatch 2026-02-25T15:01:59.778 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.586701+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/2628569396' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial072-49598-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-25T15:02:01.575 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.593145+0000 mon.c [INF] from='client.5121 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial072-49598-10", "profile": [ "k=2", "m=1", "crush-failure-doma cmd: Running main() from gmock_main.cc 2026-02-25T15:02:01.575 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [----------] Global test environment set-up. 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (2332 ms) 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (5868 ms) 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (6241 ms) 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [----------] 3 tests from NeoRadosCmd (14442 ms total) 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: 2026-02-25T15:02:01.576 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [----------] Global test environment tear-down 2026-02-25T15:02:01.577 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [==========] 3 tests from 1 test suite ran. (14442 ms total) 2026-02-25T15:02:01.577 INFO:tasks.workunit.client.0.trial072.stdout: cmd: [ PASSED ] 3 tests. 2026-02-25T15:02:01.827 INFO:tasks.workunit.client.0.trial072.stdout: pool: Running main() from gmock_main.cc 2026-02-25T15:02:01.827 INFO:tasks.workunit.client.0.trial072.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [----------] Global test environment set-up. 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolList (2329 ms) 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2582 ms) 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4277 ms) 2026-02-25T15:02:01.828 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2122 ms) 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2090 ms) 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (1272 ms) 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [----------] 6 tests from NeoRadosPools (14675 ms total) 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [----------] Global test environment tear-down 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [==========] 6 tests from 1 test suite ran. (14675 ms total) 2026-02-25T15:02:01.829 INFO:tasks.workunit.client.0.trial072.stdout: pool: [ PASSED ] 6 tests. 2026-02-25T15:02:01.885 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: starting. 2026-02-25T15:02:01.885 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: creating pool ceph_test_rados_open_pools_parallel.trial072-50139 2026-02-25T15:02:01.885 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: created object 0... 2026-02-25T15:02:01.885 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: created object 25... 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: created object 49... 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: finishing. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_1_[50228]: shutting down. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_2_[50236]: starting. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_2_[50236]: rados_pool_create. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_2_[50236]: rados_ioctx_create. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_2_[50236]: shutting down. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: ******************************* 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: starting. 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: creating pool ceph_test_rados_open_pools_parallel.trial072-50139 2026-02-25T15:02:01.886 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: created object 0... 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: created object 25... 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: created object 49... 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: finishing. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_3_[51560]: shutting down. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: ******************************* 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_4_[51561]: starting. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_4_[51561]: rados_pool_create. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_4_[51561]: rados_ioctx_create. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: process_4_[51561]: shutting down. 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: ******************************* 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: ******************************* 2026-02-25T15:02:01.887 INFO:tasks.workunit.client.0.trial072.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-25T15:02:02.860 INFO:tasks.workunit.client.0.trial072.stdout:in=osd"]} : dispatch 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.616637+0000 mon.a [INF] from='client.? v1:10.20.193.72:0/1010455376' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.620802+0000 client.admin [INF] threexx 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: got: 2026-02-25T15:01:59.623076+0000 mon.c [INF] from='client.5022 ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (7456 ms) 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (15757 ms total) 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (15757 ms total) 2026-02-25T15:02:02.861 INFO:tasks.workunit.client.0.trial072.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: Running main() from gmock_main.cc 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [----------] Global test environment set-up. 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (8027 ms) 2026-02-25T15:02:02.873 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (7705 ms) 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (15733 ms total) 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [----------] Global test environment tear-down 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (15733 ms total) 2026-02-25T15:02:02.874 INFO:tasks.workunit.client.0.trial072.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: seed 49852 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2958 ms) 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (79 ms) 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-25T15:02:02.890 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (206 ms) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (129 ms) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (267 ms) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (3640 ms total) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1976 ms) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (20 ms) 2026-02-25T15:02:02.891 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (441 ms) 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (418 ms) 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2856 ms total) 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (15794 ms total) 2026-02-25T15:02:02.892 INFO:tasks.workunit.client.0.trial072.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: Running main() from gmock_main.cc 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] Global test environment set-up. 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStat.Stat (2836 ms) 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (288 ms) 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStat.StatNS (105 ms) 2026-02-25T15:02:02.893 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (539 ms) 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (62 ms) 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] 5 tests from LibRadosStat (3832 ms total) 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1835 ms) 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (975 ms) 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-25T15:02:02.894 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (38 ms) 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2850 ms total) 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [----------] Global test environment tear-down 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (15799 ms total) 2026-02-25T15:02:02.895 INFO:tasks.workunit.client.0.trial072.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: starting. 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: creating pool ceph_test_rados_delete_pools_parallel.trial072-50179 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: created object 0... 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: created object 25... 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: created object 49... 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: finishing. 2026-02-25T15:02:02.908 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_1_[50306]: shutting down. 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_2_[50309]: starting. 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_2_[50309]: deleting pool ceph_test_rados_delete_pools_parallel.trial072-50179 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_2_[50309]: shutting down. 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: starting. 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: creating pool ceph_test_rados_delete_pools_parallel.trial072-50179 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: created object 0... 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: created object 25... 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: created object 49... 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: finishing. 2026-02-25T15:02:02.909 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_3_[51614]: shutting down. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: starting. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: listing objects. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: listed object 0... 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: listed object 25... 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: saw 50 objects 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_5_[51616]: shutting down. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_4_[51615]: starting. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_4_[51615]: deleting pool ceph_test_rados_delete_pools_parallel.trial072-50179 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: process_4_[51615]: shutting down. 2026-02-25T15:02:02.910 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:02:02.911 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******************************* 2026-02-25T15:02:02.911 INFO:tasks.workunit.client.0.trial072.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-25T15:02:06.902 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:49.059 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:06.904 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:49.062 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:06.941 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:49.133 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:06.949 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:49.141 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:06.991 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:01:49.148 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:07.013 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:49.207 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:07.017 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:49.211 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:07.024 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:01:49.217 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:07.097 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:01:49.291 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:07.605 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-25T15:02:07.605 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] Global test environment set-up. 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.ListObjects (3748 ms) 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (385 ms) 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo1,foo2,foo3 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo1 2026-02-25T15:02:07.606 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo2 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo3 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo1,foo4,foo5 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo4 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo5 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo1 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo6,foo7 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo7 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo6 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-25T15:02:07.607 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo4 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo5 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns2:foo7 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns2:foo6 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo1 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo1 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo2 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo3 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (4190 ms) 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 1 0 2026-02-25T15:02:07.608 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 10 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 13 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 7 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 14 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 0 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 15 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 11 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 5 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 8 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 6 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 3 0 2026-02-25T15:02:07.609 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 4 0 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 12 0 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 9 0 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 2 0 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (5501 ms) 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: x cursor=MIN 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=1 cursor=10:02547ec2:::1:head 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=10 cursor=10:52ea6a34:::10:head 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=13 cursor=10:566253c9:::13:head 2026-02-25T15:02:07.610 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=7 cursor=10:5c6b0b28:::7:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=14 cursor=10:62a1935d:::14:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=0 cursor=10:6cac518f:::0:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=15 cursor=10:863748b0:::15:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=11 cursor=10:89d3ae78:::11:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=5 cursor=10:b29083e3:::5:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=8 cursor=10:bd63b0f1:::8:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=6 cursor=10:c4fdafeb:::6:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=3 cursor=10:cfc208b3:::3:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=4 cursor=10:d83876eb:::4:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=12 cursor=10:de5d7c5f:::12:head 2026-02-25T15:02:07.611 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=9 cursor=10:e960b815:::9:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > oid=2 cursor=10:f905c69b:::2:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=1 cursor=10:02547ec2:::1:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:02547ec2:::1:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:02547ec2:::1:head -> 1 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=10 cursor=10:52ea6a34:::10:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:52ea6a34:::10:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:52ea6a34:::10:head -> 10 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=13 cursor=10:566253c9:::13:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:566253c9:::13:head 2026-02-25T15:02:07.612 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:566253c9:::13:head -> 13 2026-02-25T15:02:07.613 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=7 cursor=10:5c6b0b28:::7:head 2026-02-25T15:02:07.613 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:5c6b0b28:::7:head 2026-02-25T15:02:07.613 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:5c6b0b28:::7:head -> 7 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=14 cursor=10:62a1935d:::14:head 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:62a1935d:::14:head 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:62a1935d:::14:head -> 14 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=0 cursor=10:6cac518f:::0:head 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:6cac518f:::0:head 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:6cac518f:::0:head -> 0 2026-02-25T15:02:09.325 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=15 cursor=10:863748b0:::15:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:863748b0:::15:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:863748b0:::15:head -> 15 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=11 cursor=10:89d3ae78:::11:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:89d3ae78:::11:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:89d3ae78:::11:head -> 11 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=5 cursor=10:b29083e3:::5:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:b29083e3:::5:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:b29083e3:::5:head -> 5 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=8 cursor=10:bd63b0f1:::8:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:bd63b0f1:::8:head 2026-02-25T15:02:09.326 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:bd63b0f1:::8:head -> 8 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=6 cursor=10:c4fdafeb:::6:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:c4fdafeb:::6:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:c4fdafeb:::6:head -> 6 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=3 cursor=10:cfc208b3:::3:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:cfc208b3:::3:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:cfc208b3:::3:head -> 3 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=4 cursor=10:d83876eb:::4:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:d83876eb:::4:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:d83876eb:::4:head -> 4 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=12 cursor=10:de5d7c5f:::12:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:de5d7c5f:::12:head 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:de5d7c5f:::12:head -> 12 2026-02-25T15:02:09.327 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=9 cursor=10:e960b815:::9:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:e960b815:::9:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:e960b815:::9:head -> 9 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : oid=2 cursor=10:f905c69b:::2:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:f905c69b:::2:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:f905c69b:::2:head -> 2 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:d83876eb:::4:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:d83876eb:::4:head expected=10:d83876eb:::4:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:d83876eb:::4:head -> 4 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=4 expected=4 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:cfc208b3:::3:head 2026-02-25T15:02:09.328 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:cfc208b3:::3:head expected=10:cfc208b3:::3:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:cfc208b3:::3:head -> 3 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=3 expected=3 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:c4fdafeb:::6:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:c4fdafeb:::6:head expected=10:c4fdafeb:::6:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:c4fdafeb:::6:head -> 6 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=6 expected=6 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:bd63b0f1:::8:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:bd63b0f1:::8:head expected=10:bd63b0f1:::8:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:bd63b0f1:::8:head -> 8 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=8 expected=8 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:b29083e3:::5:head 2026-02-25T15:02:09.329 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:b29083e3:::5:head expected=10:b29083e3:::5:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:b29083e3:::5:head -> 5 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=5 expected=5 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:89d3ae78:::11:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:89d3ae78:::11:head expected=10:89d3ae78:::11:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:89d3ae78:::11:head -> 11 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=11 expected=11 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:02547ec2:::1:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:02547ec2:::1:head expected=10:02547ec2:::1:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:02547ec2:::1:head -> 1 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=1 expected=1 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:5c6b0b28:::7:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:5c6b0b28:::7:head expected=10:5c6b0b28:::7:head 2026-02-25T15:02:09.330 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:5c6b0b28:::7:head -> 7 2026-02-25T15:02:10.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=7 e api_io: Running main() from gmock_main.cc 2026-02-25T15:02:10.232 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-25T15:02:10.232 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] Global test environment set-up. 2026-02-25T15:02:10.232 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-25T15:02:10.232 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (3004 ms) 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: no timeout :/ 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: no timeout :/ 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: no timeout :/ 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: no timeout :/ 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: no timeout :/ 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (2509 ms) 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-25T15:02:10.233 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (61 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.Checksum (38 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (46 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (47 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (40 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (11 ms) 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-25T15:02:10.234 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.TruncTest (50 ms) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (827 ms) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (556 ms) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.RmXattr (414 ms) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIo.XattrIter (232 ms) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] 14 tests from LibRadosIo (7841 ms total) 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-25T15:02:10.235 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2022 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (214 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (613 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (411 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (605 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (196 ms) 2026-02-25T15:02:10.236 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (112 ms) 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (65 ms) 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (689 ms) 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (138 ms) 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] 10 tests from LibRadosIoEC (5071 ms total) 2026-02-25T15:02:10.237 INFO:tasks.workunit.client.0.trial072.stdout: api_io: 2026-02-25T15:02:10.238 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [----------] Global test environment tear-down 2026-02-25T15:02:10.238 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [==========] 24 tests from 2 test suites ran. (23170 ms total) 2026-02-25T15:02:10.238 INFO:tasks.workunit.client.0.trial072.stdout: api_io: [ PASSED ] 24 tests. 2026-02-25T15:02:12.073 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: Running main() from gmock_main.cc 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] Global test environment set-up. 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (3368 ms) 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.LockShared (31 ms) 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1211 ms) 2026-02-25T15:02:12.074 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1836 ms) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (841 ms) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.Unlock (479 ms) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (108 ms) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (1581 ms) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] 8 tests from LibRadosLock (9459 ms total) 2026-02-25T15:02:12.075 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1782 ms) 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (78 ms) 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1148 ms) 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1073 ms) 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (823 ms) 2026-02-25T15:02:12.076 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (709 ms) 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (124 ms) 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (60 ms) 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (5801 ms total) 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [----------] Global test environment tear-down 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (25000 ms total) 2026-02-25T15:02:12.077 INFO:tasks.workunit.client.0.trial072.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-25T15:02:12.103 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-25T15:02:12.103 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:02:12.103 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-25T15:02:12.103 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: seed 49632 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (3072 ms) 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (126 ms) 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1108 ms) 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1227 ms) 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-25T15:02:12.104 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (69 ms) 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (56 ms) 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (1007 ms) 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (683 ms) 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (7353 ms total) 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-25T15:02:12.105 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2279 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (135 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1964 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1625 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (153 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (109 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (652 ms) 2026-02-25T15:02:12.106 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (52 ms) 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (6972 ms total) 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (25027 ms total) 2026-02-25T15:02:12.107 INFO:tasks.workunit.client.0.trial072.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-25T15:02:12.199 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (4196 ms) 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1316 ms) 2026-02-25T15:02:12.200 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (5513 ms total) 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1151 ms) 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4803 ms) 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (57 ms) 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-25T15:02:12.201 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (158 ms) 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475092992 notify_id 210453397507 notifier_gid 5118 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (796 ms) 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475110912 notify_id 210453397506 notifier_gid 5118 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (100 ms) 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475102048 notify_id 210453397504 notifier_gid 5118 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (247 ms) 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475136192 notify_id 210453397508 notifier_gid 5118 2026-02-25T15:02:12.202 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (84 ms) 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475102048 notify_id 210453397509 notifier_gid 5118 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (75 ms) 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475102048 notify_id 210453397510 notifier_gid 5118 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (90 ms) 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: trying... 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475102048 notify_id 210453397511 notifier_gid 5118 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: timed out 2026-02-25T15:02:12.203 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushing 2026-02-25T15:02:12.875 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: starting. 2026-02-25T15:02:12.875 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: creating pool ceph_test_rados_list_parallel.trial072-50115 2026-02-25T15:02:12.875 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: created object 0... 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: created object 25... 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: created object 49... 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: finishing. 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_1_[50202]: shutting down. 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: starting. 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: listing objects. 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: listed object 0... 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: listed object 25... 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: saw 50 objects 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_2_[50205]: shutting down. 2026-02-25T15:02:12.876 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: starting. 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: creating pool ceph_test_rados_list_parallel.trial072-50115 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: created object 0... 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: created object 25... 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: created object 49... 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: finishing. 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_3_[51430]: shutting down. 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: starting. 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: listing objects. 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: listed object 0... 2026-02-25T15:02:12.877 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: listed object 25... 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: saw 45 objects 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_4_[51431]: shutting down. 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: starting. 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: removed 25 objects... 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: removed half of the objects 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: removed 50 objects... 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: removed 50 objects 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_5_[51432]: shutting down. 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: starting. 2026-02-25T15:02:12.878 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: creating pool ceph_test_rados_list_parallel.trial072-50115 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: created object 0... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: created object 25... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: created object 49... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: finishing. 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_6_[52290]: shutting down. 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: starting. 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: listing objects. 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: listed object 0... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: listed object 25... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: listed object 50... 2026-02-25T15:02:12.879 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: saw 53 objects 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_7_[52291]: shutting down. 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: starting. 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: added 25 objects... 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: added half of the objects 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: added 50 objects... 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: added 50 objects 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_8_[52292]: shutting down. 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:12.880 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.451 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.451 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: starting. 2026-02-25T15:02:18.451 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: creating pool ceph_test_rados_list_parallel.trial072-50115 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: created object 0... 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: created object 25... 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: created object 49... 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: finishing. 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_9_[54818]: shutting down. 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: starting. 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: listing objects. 2026-02-25T15:02:18.452 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: listed object 0... 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: listed object 25... 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: listed object 50... 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: listed object 75... 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: saw 98 objects 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_10_[54819]: shutting down. 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: starting. 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: removed 25 objects... 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: removed half of the objects 2026-02-25T15:02:18.453 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: removed 50 objects... 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: removed 50 objects 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_13_[54822]: shutting down. 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: starting. 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: added 25 objects... 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: added half of the objects 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: added 50 objects... 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: added 50 objects 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_11_[54820]: shutting down. 2026-02-25T15:02:18.454 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: starting. 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: added 25 objects... 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: added half of the objects 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: added 50 objects... 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: added 50 objects 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_12_[54821]: shutting down. 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.455 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: starting. 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: creating pool ceph_test_rados_list_parallel.trial072-50115 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: created object 0... 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: created object 25... 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: created object 49... 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: finishing. 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_14_[58775]: shutting down. 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: starting. 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listing objects. 2026-02-25T15:02:18.456 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 0... 2026-02-25T15:02:18.457 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 25... 2026-02-25T15:02:18.682 INFO:tasks.workunit.client.0.trial072.stdout: 406 active+clean 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 233 unknown 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 39 creating+peering 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 19 creating+activating 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: io: 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: client: 193 B/s rd, 2.5 KiB/s wr, 0 op/s rd, 2 op/s wr 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ OK ] LibRadosService.StatusFormat (5662 ms) 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-25T15:02:18.683 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ OK ] LibRadosService.Status (20073 ms) 2026-02-25T15:02:18.684 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [----------] 4 tests from LibRadosService (31564 ms total) 2026-02-25T15:02:18.684 INFO:tasks.workunit.client.0.trial072.stdout: api_service: 2026-02-25T15:02:18.684 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [----------] Global test environment tear-down 2026-02-25T15:02:18.684 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [==========] 4 tests from 1 test suite ran. (31564 ms total) 2026-02-25T15:02:18.684 INFO:tasks.workunit.client.0.trial072.stdout: api_service: [ PASSED ] 4 tests. 2026-02-25T15:02:21.575 INFO:tasks.workunit.client.0.trial072.stdout: list: Running main() from gmock_main.cc 2026-02-25T15:02:21.575 INFO:tasks.workunit.client.0.trial072.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:02:21.575 INFO:tasks.workunit.client.0.trial072.stdout: list: [----------] Global test environment set-up. 2026-02-25T15:02:21.575 INFO:tasks.workunit.client.0.trial072.stdout: list: [----------] 3 tests from NeoradosList 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ OK ] NeoradosList.ListObjects (8210 ms) 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ OK ] NeoradosList.ListObjectsNS (6201 ms) 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ OK ] NeoradosList.ListObjectsMany (20020 ms) 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [----------] 3 tests from NeoradosList (34432 ms total) 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [----------] Global test environment tear-down 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [==========] 3 tests from 1 test suite ran. (34432 ms total) 2026-02-25T15:02:21.576 INFO:tasks.workunit.client.0.trial072.stdout: list: [ PASSED ] 3 tests. 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: seed 49542 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-25T15:02:22.132 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (3109 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (434 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (62 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (12637 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (23 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (25 ms) 2026-02-25T15:02:22.133 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (48 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (25 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (50 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (51 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (524 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (109 ms) 2026-02-25T15:02:22.134 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (42 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (33 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (135 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (778 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (58 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (45 ms) 2026-02-25T15:02:22.135 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (39 ms) 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (39 ms) 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (57 ms) 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (18333 ms total) 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (4217 ms) 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-25T15:02:22.136 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (135 ms) 2026-02-25T15:02:22.137 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-25T15:02:22.907 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadO api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5314 ms) 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (514 ms) 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20408 ms) 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: attempt 0 of 20 2026-02-25T15:02:22.908 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (9551 ms) 2026-02-25T15:02:22.909 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35789 ms total) 2026-02-25T15:02:22.909 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: 2026-02-25T15:02:22.909 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-25T15:02:22.909 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35789 ms total) 2026-02-25T15:02:22.909 INFO:tasks.workunit.client.0.trial072.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-25T15:02:22.947 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 50... 2026-02-25T15:02:22.947 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 75... 2026-02-25T15:02:22.947 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 100... 2026-02-25T15:02:22.947 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: listed object 125... 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: saw 150 objects 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_15_[58776]: shutting down. 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: starting. 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: added 25 objects... 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: added half of the objects 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: added 50 objects... 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: added 50 objects 2026-02-25T15:02:22.948 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: process_16_[58777]: shutting down. 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******************************* 2026-02-25T15:02:22.949 INFO:tasks.workunit.client.0.trial072.stdout: list_parallel: ******* SUCCESS ********** 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify_test_cb 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (3398 ms) 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-25T15:02:23.156 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94129736764368 err -107 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1144 ms) 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94129736772000 err -107 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1139 ms) 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 150323855362 cookie 94129736789392 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (65 ms) 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 154618822657 cookie 94129736799840 2026-02-25T15:02:23.157 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (1081 ms) 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 154618822656 cookie 94129736803024 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (804 ms) 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 158913789952 cookie 94129736802560 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 158913789952 cookie 94129738884624 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (125 ms) 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 158913789957 cookie 94129736805520 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 163208757254 cookie 94129736805520 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3116 ms) 2026-02-25T15:02:23.158 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94129736805520 err -107 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_cb from 4804 notify_id 197568495624 cookie 94129736805520 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5125 ms) 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94129736805520 err -107 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1196 ms) 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (17200 ms total) 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-25T15:02:23.159 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: watch_notify_test_cb 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (3155 ms) 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (3155 ms total) 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (36060 ms total) 2026-02-25T15:02:23.160 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-25T15:02:34.825 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:16.982 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:34.841 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:16.998 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:34.924 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:17.082 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:34.964 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:17.158 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:34.967 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:17.161 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:35.084 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:17.276 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:35.085 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:17.277 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:35.161 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:17.355 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:35.262 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:17.454 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:36.113 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushed 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3082 ms) 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: trying... 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475102048 notify_id 219043332097 notifier_gid 5118 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: timed out 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushing 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushed 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3052 ms) 2026-02-25T15:02:36.114 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: List watches 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify2 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475136160 notify_id 227633266690 notifier_gid 5118 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify2 done 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: watch_check 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: unwatch2 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushing 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: done 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3074 ms) 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: List watches 2026-02-25T15:02:36.115 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify2 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: handle_notify cookie 94235475136112 notify_id 236223201281 notifier_gid 5118 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: notify2 done 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: watch_check 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: unwatch2 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: flushing 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: done 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3399 ms) 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (20177 ms total) 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (49011 ms total) 2026-02-25T15:02:36.116 INFO:tasks.workunit.client.0.trial072.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-25T15:02:37.833 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-25T15:02:37.833 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-25T15:02:37.833 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-25T15:02:37.833 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: handle_notify cookie 94786724685952 notify_id 146028888065 notifier_gid 4894 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (8174 ms) 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Trying... 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: handle_notify cookie 94786737505376 notify_id 163208757248 notifier_gid 4995 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Waiting for 3.000000000s 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Timed out. 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Flushing... 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: Flushed... 2026-02-25T15:02:37.834 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8598 ms) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (16773 ms total) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (2916 ms) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (8226 ms) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (12915 ms) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (9839 ms) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (33898 ms total) 2026-02-25T15:02:37.835 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: 2026-02-25T15:02:37.836 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-25T15:02:37.836 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (50672 ms total) 2026-02-25T15:02:37.836 INFO:tasks.workunit.client.0.trial072.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: Running main() from gmock_main.cc 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [----------] Global test environment set-up. 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (12302 ms) 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8357 ms) 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (32407 ms) 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [----------] 3 tests from NeoradosECList (53066 ms total) 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [----------] Global test environment tear-down 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (53066 ms total) 2026-02-25T15:02:40.212 INFO:tasks.workunit.client.0.trial072.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-25T15:02:50.968 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-25T15:02:50.969 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (7308 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (2956 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (4172 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3385 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2967 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (8947 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (34115 ms) 2026-02-25T15:02:50.970 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (63853 ms total) 2026-02-25T15:02:50.971 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: 2026-02-25T15:02:50.971 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-25T15:02:50.971 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (63853 ms total) 2026-02-25T15:02:50.971 INFO:tasks.workunit.client.0.trial072.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-25T15:02:52.748 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:34.905 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:52.757 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:34.914 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:52.805 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:34.963 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.019 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:35.213 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.027 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:35.220 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.126 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:35.318 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.128 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:35.322 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.160 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:35.353 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:53.166 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:35.360 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:02:54.595 INFO:tasks.workunit.client.0.trial072.stdout:pPP (108 ms) 2026-02-25T15:02:54.595 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-25T15:02:54.595 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (145 ms) 2026-02-25T15:02:54.595 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (42 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (137 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (63 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (41 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (169 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (433 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (200 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (94 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (188 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (21329 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (3038 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (146 ms) 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-25T15:02:54.596 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (37 ms) 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (121 ms) 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (30651 ms total) 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (67528 ms total) 2026-02-25T15:02:54.597 INFO:tasks.workunit.client.0.trial072.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-25T15:03:02.830 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: Running main() from gmock_main.cc 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [----------] Global test environment set-up. 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (7266 ms) 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (2948 ms) 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (4173 ms) 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-25T15:03:02.831 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (4419 ms) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (5634 ms) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (11695 ms) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (33863 ms) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (5663 ms) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (75666 ms total) 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [----------] Global test environment tear-down 2026-02-25T15:03:02.832 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (75666 ms total) 2026-02-25T15:03:02.833 INFO:tasks.workunit.client.0.trial072.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-25T15:03:06.669 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: Running main() from gmock_main.cc 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [----------] Global test environment set-up. 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolList (3599 ms) 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4648 ms) 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3120 ms) 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-25T15:03:06.670 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3098 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3389 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (8445 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (17787 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (15234 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (20262 ms) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [----------] 9 tests from LibRadosPools (79586 ms total) 2026-02-25T15:03:06.671 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: 2026-02-25T15:03:06.672 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [----------] Global test environment tear-down 2026-02-25T15:03:06.672 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (79586 ms total) 2026-02-25T15:03:06.672 INFO:tasks.workunit.client.0.trial072.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-25T15:03:08.681 INFO:tasks.workunit.client.0.trial072.stdout: misc: Running main() from gmock_main.cc 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [----------] Global test environment set-up. 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.Version (2331 ms) 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (2763 ms) 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.LongName (5151 ms) 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-25T15:03:08.682 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (4161 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (4425 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (5624 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.Exec (9829 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (13354 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (10011 ms) 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-25T15:03:08.683 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.BigObject (7863 ms) 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (7156 ms) 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (8857 ms) 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [----------] 12 tests from NeoRadosMisc (81531 ms total) 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [----------] Global test environment tear-down 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [==========] 12 tests from 1 test suite ran. (81531 ms total) 2026-02-25T15:03:08.684 INFO:tasks.workunit.client.0.trial072.stdout: misc: [ PASSED ] 12 tests. 2026-02-25T15:03:08.687 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] Global test environment set-up. 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-25T15:03:08.688 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:01:47.359+0000 7ff184e24880 -1 failed for service _ceph-mon._tcp 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:01:47.359+0000 7ff184e24880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (278 ms) 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5002 ms) 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5281 ms total) 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: started 0x562da8769fb0 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: started 0x562da8951a70 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: started 2 aios 2026-02-25T15:03:08.689 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: waiting 0x562da8769fb0 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: waiting 0x562da8951a70 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: done. 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (8181 ms) 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (8181 ms total) 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.Exec (1659 ms) 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-25T15:03:08.690 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (77 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (106 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4246 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (59815 ms) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] 8 tests from LibRadosMisc (65905 ms total) 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: 2026-02-25T15:03:08.691 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [----------] Global test environment tear-down 2026-02-25T15:03:08.692 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (81587 ms total) 2026-02-25T15:03:08.692 INFO:tasks.workunit.client.0.trial072.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-25T15:03:12.078 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:54.235 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.079 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:54.237 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.105 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:02:54.262 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.107 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:54.299 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.109 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:54.303 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.109 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:54.301 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.110 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:54.304 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.134 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:02:54.326 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:12.137 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:02:54.331 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:16.958 INFO:tasks.workunit.client.0.trial072.stdout: io: Running main() from gmock_main.cc 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [----------] Global test environment set-up. 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.Limits (7330 ms) 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3984 ms) 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.ReadOp (3105 ms) 2026-02-25T15:03:16.959 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.SparseRead (4421 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3890 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (9529 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (11736 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (8379 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (8294 ms) 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-25T15:03:16.960 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.Trunc (9358 ms) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.Remove (9528 ms) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (4091 ms) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.RmXattr (3067 ms) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3098 ms) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [----------] 14 tests from NeoRadosIo (89817 ms total) 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: 2026-02-25T15:03:16.961 INFO:tasks.workunit.client.0.trial072.stdout: io: [----------] Global test environment tear-down 2026-02-25T15:03:16.962 INFO:tasks.workunit.client.0.trial072.stdout: io: [==========] 14 tests from 1 test suite ran. (89817 ms total) 2026-02-25T15:03:16.962 INFO:tasks.workunit.client.0.trial072.stdout: io: [ PASSED ] 14 tests. 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: Running main() from gmock_main.cc 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [----------] Global test environment set-up. 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (8176 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (4169 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3407 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3068 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (5685 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (9826 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (9647 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (10407 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (9425 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (9177 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (8535 ms) 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-25T15:03:21.189 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3136 ms) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3074 ms) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3242 ms) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3053 ms) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (94033 ms total) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [----------] Global test environment tear-down 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (94033 ms total) 2026-02-25T15:03:21.190 INFO:tasks.workunit.client.0.trial072.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: seed 49765 2026-02-25T15:03:23.234 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (6880 ms) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2126 ms) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2052 ms) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1274 ms) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4168 ms) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (16501 ms total) 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:23.235 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (6832 ms) 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (7200 ms) 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (13636 ms) 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (6736 ms) 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3172 ms) 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-25T15:03:23.236 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-676-gc824a7fa/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial072-49765-7 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (19856 ms) 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (57434 ms total) 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (2 ms) 2026-02-25T15:03:23.237 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5257 ms) 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5260 ms total) 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2195 ms) 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2032 ms) 2026-02-25T15:03:23.238 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ api_snapshots: Running main() from gmock_main.cc 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5858 ms) 2026-02-25T15:03:27.158 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2052 ms) 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2102 ms) 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2078 ms) 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12091 ms total) 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (6412 ms) 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-25T15:03:27.159 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (13013 ms) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (20615 ms) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (40042 ms total) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (5344 ms) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (4931 ms) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (3922 ms) 2026-02-25T15:03:27.160 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2110 ms) 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (16308 ms total) 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (3431 ms) 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3981 ms) 2026-02-25T15:03:27.161 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (7412 ms total) 2026-02-25T15:03:27.162 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: 2026-02-25T15:03:27.162 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-25T15:03:27.162 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (100069 ms total) 2026-02-25T15:03:27.162 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50011 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50011 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49787 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49787 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49673 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49673 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49531 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49531 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49731 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49731 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50122 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50122 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50152 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50152 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49553 2026-02-25T15:03:27.163 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49553 2026-02-25T15:03:32.099 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:14.256 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.125 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:14.319 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.126 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:14.284 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.128 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:14.322 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.151 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:14.343 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.153 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:14.345 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.155 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:14.313 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.156 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:14.350 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:32.181 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:14.374 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:45.265 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: Running main() from gmock_main.cc 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] Global test environment set-up. 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (10238 ms) 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4429 ms) 2026-02-25T15:03:45.266 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4186 ms) 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (10839 ms) 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (17799 ms) 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (47493 ms total) 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (14522 ms) 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-25T15:03:45.267 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (12229 ms) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (13495 ms) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6290 ms) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4057 ms) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial072-50498-11. 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: Waiting for snaps to purge. 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20016 ms) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (70612 ms total) 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: 2026-02-25T15:03:45.268 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [----------] Global test environment tear-down 2026-02-25T15:03:45.269 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (118106 ms total) 2026-02-25T15:03:45.269 INFO:tasks.workunit.client.0.trial072.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-25T15:03:46.346 INFO:tasks.workunit.client.0.trial072.stdout: OK ] LibRadosSnapshotsECPP.RollbackPP (2049 ms) 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2012 ms) 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8289 ms total) 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4400 ms) 2026-02-25T15:03:46.347 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3516 ms) 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3930 ms) 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11848 ms total) 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (119255 ms total) 2026-02-25T15:03:46.348 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-25T15:03:46.349 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-25T15:03:46.349 INFO:tasks.workunit.client.0.trial072.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-25T15:03:52.179 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:34.335 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.180 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:34.337 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.206 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:34.398 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.207 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:34.399 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.209 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:34.403 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.210 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:34.404 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.216 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:34.373 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.234 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:34.426 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:52.237 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:34.430 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-25T15:03:53.309 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: seed 49691 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (3036 ms) 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (519 ms) 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (80 ms) 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (112 ms) 2026-02-25T15:03:53.310 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (23 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (18 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (103 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (35 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (127 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (21 ms) 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-25T15:03:53.311 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (121 ms) 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (86 ms) 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (39766 ms) 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (5213 ms) 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: done waiting, doing copies 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-25T15:03:53.312 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: done waiting 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (68973 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (43 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (25 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4518 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-25T15:03:53.313 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-25T15:03:53.314 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 22 tests fr api_aio: Running main() from gmock_main.cc 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] Global test environment set-up. 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3540 ms) 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-25T15:03:57.223 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6773 ms) 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (4186 ms) 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2366 ms) 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2919 ms) 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6365 ms) 2026-02-25T15:03:57.224 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (8080 ms) 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (13360 ms) 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (8123 ms) 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (8192 ms) 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (8910 ms) 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-25T15:03:57.225 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (8799 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3144 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3079 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.Flush (3227 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3059 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3049 ms) 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-25T15:03:57.226 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (2916 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3173 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3172 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3091 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2661 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2932 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3077 ms) 2026-02-25T15:03:57.227 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2945 ms) 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3049 ms) 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3053 ms) 2026-02-25T15:03:57.228 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-25T15:04:10.350 INFO:tasks.workunit.client.0.trial072.stdout: ap api_aio_pp: Running main() from gmock_main.cc 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3541 ms) 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (26816 ms) 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-25T15:04:10.351 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (24133 ms) 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (7530 ms) 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (8087 ms) 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (7616 ms) 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (4978 ms) 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-25T15:04:10.352 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3097 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3067 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3221 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3049 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3047 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2976 ms) 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-25T15:04:10.353 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3108 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3236 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2592 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3165 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2868 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3149 ms) 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-25T15:04:10.354 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (2874 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3075 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3032 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2912 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3026 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3143 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (2825 ms) 2026-02-25T15:04:10.355 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-25T15:04:12.227 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:54.384 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.229 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:54.386 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.230 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:54.424 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.231 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:54.426 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.255 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:54.448 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.256 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:54.449 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.260 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:03:54.417 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.261 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:03:54.455 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:12.286 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:03:54.478 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:20.420 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAiom LibRadosMiscPP (122830 ms total) 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (1413 ms) 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (1413 ms total) 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (145 ms) 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (90 ms) 2026-02-25T15:04:20.421 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (235 ms total) 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (172 ms) 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (55 ms) 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (227 ms total) 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (249 ms) 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-25T15:04:20.422 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (20 ms) 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (270 ms total) 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (784 ms) 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (784 ms total) 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (153331 ms total) 2026-02-25T15:04:20.423 INFO:tasks.workunit.client.0.trial072.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-25T15:04:20.424 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:04:20.424 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50046 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50046 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49427 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49427 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49489 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49489 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49948 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49948 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49418 2026-02-25T15:04:20.425 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49418 2026-02-25T15:04:35.228 INFO:tasks.workunit.client.0.trial072.stdout:xpected=7 2026-02-25T15:04:35.228 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:566253c9:::13:head 2026-02-25T15:04:35.228 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:566253c9:::13:head expected=10:566253c9:::13:head 2026-02-25T15:04:35.228 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:566253c9:::13:head -> 13 2026-02-25T15:04:35.228 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=13 expected=13 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:62a1935d:::14:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:62a1935d:::14:head expected=10:62a1935d:::14:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:62a1935d:::14:head -> 14 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=14 expected=14 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:863748b0:::15:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:863748b0:::15:head expected=10:863748b0:::15:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:863748b0:::15:head -> 15 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=15 expected=15 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:6cac518f:::0:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:6cac518f:::0:head expected=10:6cac518f:::0:head 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:6cac518f:::0:head -> 0 2026-02-25T15:04:35.229 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=0 expected=0 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:52ea6a34:::10:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:52ea6a34:::10:head expected=10:52ea6a34:::10:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:52ea6a34:::10:head -> 10 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=10 expected=10 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:f905c69b:::2:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:f905c69b:::2:head expected=10:f905c69b:::2:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:f905c69b:::2:head -> 2 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=2 expected=2 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:e960b815:::9:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:e960b815:::9:head expected=10:e960b815:::9:head 2026-02-25T15:04:35.230 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:e960b815:::9:head -> 9 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=9 expected=9 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : seek to 10:de5d7c5f:::12:head 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : cursor()=10:de5d7c5f:::12:head expected=10:de5d7c5f:::12:head 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: > 10:de5d7c5f:::12:head -> 12 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: : entry=12 expected=12 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (7273 ms) 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (127078 ms) 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: split 0/5 -> MIN 10:33333333::::head 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: split 1/5 -> 10:33333333::::head 10:66666666::::head 2026-02-25T15:04:35.231 INFO:tasks.workunit.client.0.trial072.stdout: api_list: split 2/5 -> 10:66666666::::head 10:99999999::::head 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: split 3/5 -> 10:99999999::::head 10:cccccccc::::head 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: split 4/5 -> 10:cccccccc::::head MAX 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (12480 ms) 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 7 tests from LibRadosList (160659 ms total) 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1265 ms) 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo1,foo2,foo3 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo1 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo2 2026-02-25T15:04:35.232 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo3 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo1,foo4,foo5 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo4 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo5 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo1 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset foo6,foo7 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo7 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: foo6 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo4 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo5 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns2:foo7 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns2:foo6 2026-02-25T15:04:35.233 INFO:tasks.workunit.client.0.trial072.stdout: api_list: ns1:foo1 2026-02-25T15:04:35.234 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo1 2026-02-25T15:04:35.234 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo2 2026-02-25T15:04:35.234 INFO:tasks.workunit.client.0.trial072.stdout: api_list: :foo3 2026-02-25T15:04:35.234 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (459 ms) 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 1 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 10 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 13 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 7 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 14 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 0 0 2026-02-25T15:04:41.463 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 15 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 11 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 5 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 8 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 6 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 3 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 4 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 12 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 9 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 2 0 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-25T15:04:41.464 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (816 ms) 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 3 tests from LibRadosListEC (2541 ms total) 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3125 ms) 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] 1 test from LibRadosListNP (3125 ms total) 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [----------] Global test environment tear-down 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [==========] 11 tests from 3 test suites ran. (174386 ms total) 2026-02-25T15:04:41.465 INFO:tasks.workunit.client.0.trial072.stdout: api_list: [ PASSED ] 11 tests. 2026-02-25T15:04:52.290 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:34.447 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.317 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:34.474 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.318 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:34.511 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.319 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:34.513 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.345 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:34.537 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.345 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:34.538 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.359 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:34.516 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.361 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:34.555 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:04:52.385 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:34.577 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.354 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:54.510 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.355 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:54.512 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.378 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:04:54.535 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.382 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:54.574 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.383 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:54.576 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.383 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:54.575 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.383 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:54.577 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.406 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:04:54.599 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:12.407 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:04:54.601 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.446 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:19.603 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.448 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:19.605 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.472 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:19.629 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.475 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:19.669 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.476 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:19.670 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.477 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:19.669 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.477 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:19.669 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.496 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:19.690 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:37.499 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:19.691 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:52.713 INFO:tasks.workunit.client.0.trial072.stdout:i_aio: [ OK ] LibRadosAio.CancelBeforeComplete (2910 ms) 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (3043 ms) 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] 29 tests from LibRadosAio (133207 ms total) 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (6968 ms) 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-25T15:05:52.714 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7366 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6835 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6868 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7286 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6994 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6829 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7349 ms) 2026-02-25T15:05:52.715 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6767 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6924 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6927 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7219 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7007 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6820 ms) 2026-02-25T15:05:52.716 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7391 ms) 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6887 ms) 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112445 ms total) 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [----------] Global test environment tear-down 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (245653 ms total) 2026-02-25T15:05:52.717 INFO:tasks.workunit.client.0.trial072.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-25T15:05:57.493 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:39.650 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.495 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:39.688 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.495 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:39.652 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.496 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:39.690 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.516 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:39.673 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.517 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:39.711 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.519 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:39.711 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.520 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:39.712 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:05:57.540 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:39.732 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.532 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:59.688 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.533 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:59.690 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.551 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:05:59.708 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.556 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:59.748 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.557 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:59.749 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.561 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:59.755 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.562 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:59.756 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.576 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:05:59.768 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:17.581 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:05:59.774 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout:o.RoundTripAppendPP (3116 ms) 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3183 ms) 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3094 ms) 2026-02-25T15:06:30.702 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2708 ms) 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: sending pool EIO time: 2026-02-25T15:04:26.458691+0000 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-676-gc824a7fa/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (7936 ms) 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3106 ms) 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (163321 ms total) 2026-02-25T15:06:30.703 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3131 ms) 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9056 ms) 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14767 ms) 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3162 ms) 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30118 ms total) 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:06:30.704 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3037 ms) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3037 ms total) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13850 ms) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7222 ms) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7003 ms) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6824 ms) 2026-02-25T15:06:30.705 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3079 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6947 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7419 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6731 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6947 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7328 ms) 2026-02-25T15:06:30.706 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-25T15:06:30.707 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6872 ms) 2026-02-25T15:06:30.707 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-25T15:06:30.707 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6938 ms) 2026-02-25T15:06:37.569 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:19.726 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.571 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:19.728 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.590 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:19.747 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.595 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:19.789 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.596 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:19.790 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.597 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:19.789 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.599 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:19.791 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.615 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:19.809 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:37.618 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:19.810 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.613 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:39.769 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.615 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:39.772 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.627 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:39.820 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.628 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:39.822 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.636 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:39.793 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.640 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:39.832 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.642 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:39.834 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.648 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:39.842 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:06:57.661 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:39.853 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.026 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:47.183 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.027 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:47.221 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.029 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:47.186 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.031 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:47.224 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.043 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:47.236 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.049 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:47.206 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.057 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:47.249 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.058 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:47.250 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:05.070 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:47.262 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.645 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:59.802 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.647 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:59.841 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.648 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:59.805 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.649 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:59.842 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.663 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:06:59.820 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.663 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:06:59.857 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.673 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:59.865 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.673 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:59.866 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:17.688 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:06:59.880 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:25.987 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-25T15:07:25.987 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6912 ms) 2026-02-25T15:07:25.987 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-25T15:07:25.987 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3086 ms) 2026-02-25T15:07:25.987 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6856 ms) 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7303 ms) 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6914 ms) 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (6884 ms) 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7240 ms) 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-25T15:07:25.988 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6879 ms) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139244 ms total) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-25T15:07:25.989 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (70 ms) 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (6 ms) 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (77 ms total) 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (338924 ms total) 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-25T15:07:25.990 INFO:tasks.workunit.client.0.trial072.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49439 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49439 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50227 2026-02-25T15:07:25.995 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50227 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49612 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49612 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50313 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50313 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49709 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49709 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50097 2026-02-25T15:07:25.996 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50097 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50398 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50398 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49647 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49647 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49991 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49991 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50194 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50194 2026-02-25T15:07:25.997 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50068 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50068 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50280 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50280 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49916 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49916 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49572 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49572 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.998 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50365 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50365 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49839 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49839 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49411 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49411 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49469 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49469 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49755 2026-02-25T15:07:25.999 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49755 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49508 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49508 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49862 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49862 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=49889 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 49889 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50168 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50168 2026-02-25T15:07:26.000 INFO:tasks.workunit.client.0.trial072.stderr:+ for t in "${!pids[@]}" 2026-02-25T15:07:26.001 INFO:tasks.workunit.client.0.trial072.stderr:+ pid=50435 2026-02-25T15:07:26.001 INFO:tasks.workunit.client.0.trial072.stderr:+ wait 50435 2026-02-25T15:07:26.001 INFO:tasks.workunit.client.0.trial072.stderr:+ exit 0 2026-02-25T15:07:26.001 INFO:tasks.workunit.client.0.trial072.stderr:+ cleanup 2026-02-25T15:07:26.001 INFO:tasks.workunit.client.0.trial072.stderr:+ pkill -P 49405 2026-02-25T15:07:26.002 INFO:tasks.workunit.client.0.trial072.stderr:+ true 2026-02-25T15:07:26.003 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-25T15:07:26.003 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-25T15:07:26.032 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-25T15:07:26.032 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-25T15:07:26.416 DEBUG:teuthology.parallel:result is None 2026-02-25T15:07:26.417 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:07:26.442 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:07:26.442 DEBUG:teuthology.orchestra.run.trial072:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-25T15:07:26.498 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-25T15:07:26.498 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-25T15:07:26.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T15:07:26.513 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:07:26.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.581+0000 7fc1fdacd640 10 monclient: get_monmap_and_config 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.581+0000 7fc1fdacd640 10 monclient: build_initial_monmap 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.581+0000 7fc1fdacd640 10 monclient: monmap: 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:26.582257+0000 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:26.582257+0000 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 1 Processor -- start 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 1 -- start start 2026-02-25T15:07:26.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient: init 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-a con 0x7fc1f8058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-c con 0x7fc1f80b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-b con 0x7fc1f81626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f81655c0 con 0x7fc1f8058da0 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f80b12b0 con 0x7fc1f81626a0 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f80b1590 con 0x7fc1f80b0410 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.582+0000 7fc1fdacd640 10 monclient(hunting): authenticate will time out at 3390.174663s 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.583+0000 7fc1f77fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fc1f8058da0 0x7fc1f81647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50412/0 (socket says 10.20.193.21:50412) 2026-02-25T15:07:26.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.583+0000 7fc1f77fe640 1 -- 10.20.193.21:0/592140877 learned_addr learned my addr 10.20.193.21:0/592140877 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:26.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97462807 0 0) 0x7fc1f81655c0 con 0x7fc1f8058da0 2026-02-25T15:07:26.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): my global_id is 28140 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1dc003610 con 0x7fc1f8058da0 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712514071 0 0) 0x7fc1f80b12b0 con 0x7fc1f81626a0 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): my global_id is 29113 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f81655c0 con 0x7fc1f81626a0 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230666374 0 0) 0x7fc1f80b1590 con 0x7fc1f80b0410 2026-02-25T15:07:26.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 10 monclient(hunting): my global_id is 30767 2026-02-25T15:07:26.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.584+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f80b12b0 con 0x7fc1f80b0410 2026-02-25T15:07:26.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1422674104 0 0) 0x7fc1dc003610 con 0x7fc1f8058da0 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 >> v1:10.20.193.68:6789/0 conn(0x7fc1f80b0410 legacy=0x7fc1f8164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 >> v1:10.20.193.31:6789/0 conn(0x7fc1f81626a0 legacy=0x7fc1f81c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 monclient: found mon.noname-a 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f80b1870 con 0x7fc1f8058da0 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:26.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1e4002df0 con 0x7fc1f8058da0 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1fdacd640 5 monclient: authenticate success, global_id 28140 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1fdacd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1f67fc640 10 monclient: dump: 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.595 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.586+0000 7fc1fdacd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e4002fc0 con 0x7fc1f8058da0 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 1 -- 10.20.193.21:0/592140877 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1e4003400 con 0x7fc1f8058da0 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1f67fc640 10 monclient: dump: 2026-02-25T15:07:26.596 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 4 set_mon_vals no callback set 2026-02-25T15:07:26.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 10 monclient: shutdown 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 1 -- 10.20.193.21:0/592140877 >> v1:10.20.193.21:6789/0 conn(0x7fc1f8058da0 legacy=0x7fc1f81647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 1 -- 10.20.193.21:0/592140877 shutdown_connections 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 1 -- 10.20.193.21:0/592140877 >> 10.20.193.21:0/592140877 conn(0x7fc1f80b65f0 msgr2=0x7fc1f80b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 1 -- 10.20.193.21:0/592140877 shutdown_connections 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.587+0000 7fc1fdacd640 1 -- 10.20.193.21:0/592140877 wait complete. 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient: build_initial_monmap 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient: monmap: 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:26.598 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 librados: starting msgr at 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 librados: starting objecter 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 Processor -- start 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 -- start start 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 librados: setting wanted keys 2026-02-25T15:07:26.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 librados: calling monclient init 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient: init 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-a con 0x7fc1f8058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-c con 0x7fc1f80b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient(hunting): picked mon.noname-b con 0x7fc1f81626a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f8147c20 con 0x7fc1f8058da0 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f813e390 con 0x7fc1f81626a0 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f813e670 con 0x7fc1f80b0410 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.588+0000 7fc1fdacd640 10 monclient(hunting): authenticate will time out at 3390.180887s 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1f77fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fc1f8058da0 0x7fc1f81170c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50418/0 (socket says 10.20.193.21:50418) 2026-02-25T15:07:26.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1f77fe640 1 -- 10.20.193.21:0/3423907815 learned_addr learned my addr 10.20.193.21:0/3423907815 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter ms_handle_connect 0x7fc1f8058da0 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter ms_handle_connect 0x7fc1f80b0410 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter ms_handle_connect 0x7fc1f81626a0 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.589+0000 7fc1d3fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292698704 0 0) 0x7fc1f8147c20 con 0x7fc1f8058da0 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): my global_id is 28143 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c8003610 con 0x7fc1f8058da0 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447026832 0 0) 0x7fc1f813e670 con 0x7fc1f80b0410 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): my global_id is 30770 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f8147c20 con 0x7fc1f80b0410 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859223976 0 0) 0x7fc1f813e390 con 0x7fc1f81626a0 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 10 monclient(hunting): my global_id is 29116 2026-02-25T15:07:26.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.590+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1f813e670 con 0x7fc1f81626a0 2026-02-25T15:07:26.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1831369040 0 0) 0x7fc1c8003610 con 0x7fc1f8058da0 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f813e390 con 0x7fc1f8058da0 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1e4003310 con 0x7fc1f8058da0 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): dump: 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.606 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2458008339 0 0) 0x7fc1f8147c20 con 0x7fc1f80b0410 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1c8003610 con 0x7fc1f80b0410 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1e8003060 con 0x7fc1f80b0410 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): dump: 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.607 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3915846156 0 0) 0x7fc1f813e670 con 0x7fc1f81626a0 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1f8147c20 con 0x7fc1f81626a0 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1ec003370 con 0x7fc1f81626a0 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:26.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.592+0000 7fc1d3fff640 10 monclient(hunting): dump: 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1037987131 0 0) 0x7fc1f813e390 con 0x7fc1f8058da0 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 >> v1:10.20.193.68:6789/0 conn(0x7fc1f80b0410 legacy=0x7fc1f8139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 >> v1:10.20.193.31:6789/0 conn(0x7fc1f81626a0 legacy=0x7fc1f8146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 1 monclient: found mon.a 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f813e950 con 0x7fc1f8058da0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 10 monclient: _finish_auth 0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 5 monclient: authenticate success, global_id 28143 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 10 monclient: _renew_subs 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f813f150 con 0x7fc1f8058da0 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 10 client.28143.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 10 monclient: _renew_subs 2026-02-25T15:07:26.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1f813a790 con 0x7fc1f8058da0 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.594+0000 7fc1fdacd640 1 librados: init done 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.595+0000 7fc1fdacd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.595+0000 7fc1fdacd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.595+0000 7fc1fdacd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:26.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.595+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f80b3dc0 con 0x7fc1f8058da0 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e40029a0 con 0x7fc1f8058da0 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1e4004b80 con 0x7fc1f8058da0 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1f5ffb640 4 set_mon_vals no callback set 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.685+0000 7fc1d3fff640 10 monclient: dump: 2026-02-25T15:07:26.688 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.686+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fc1e401e060 con 0x7fc1f8058da0 2026-02-25T15:07:26.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.687+0000 7fc1f6ffd640 10 monclient: get_auth_request con 0x7fc1c807a010 auth_method 0 2026-02-25T15:07:26.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.687+0000 7fc1d3fff640 10 client.28143.objecter ms_handle_connect 0x7fc1c807a010 2026-02-25T15:07:26.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fc1e405ac00 con 0x7fc1f8058da0 2026-02-25T15:07:26.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 10 client.28143.objecter ms_dispatch2 0x7fc1f8000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:26.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 3 client.28143.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:26.691 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 3 client.28143.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:26.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 20 client.28143.objecter dump_active .. 0 homeless 2026-02-25T15:07:26.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fc1f80b3dc0 con 0x7fc1f8058da0 2026-02-25T15:07:26.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.692 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.689+0000 7fc1d3fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:26.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.791+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1f813f420 con 0x7fc1c807a010 2026-02-25T15:07:26.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.793+0000 7fc1d3fff640 1 -- 10.20.193.21:0/3423907815 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125409 (unknown 2965378022 0 3746370452) 0x7fc1f813f420 con 0x7fc1c807a010 2026-02-25T15:07:26.797 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:26.799 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:07:26.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 10 librados: watch_flush enter 2026-02-25T15:07:26.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 10 librados: watch_flush exit 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 20 client.28143.objecter shutdown clearing up homeless session... 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 10 client.28143.objecter successfully canceled tick 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 >> v1:10.20.193.72:6800/2463505645 conn(0x7fc1c807a010 legacy=0x7fc1c809a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 10 monclient: shutdown 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.794+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 >> v1:10.20.193.21:6789/0 conn(0x7fc1f8058da0 legacy=0x7fc1f81170c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.795+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 shutdown_connections 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.795+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 >> 10.20.193.21:0/3423907815 conn(0x7fc1f80b65f0 msgr2=0x7fc1f8059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.795+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 shutdown_connections 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.795+0000 7fc1fdacd640 1 -- 10.20.193.21:0/3423907815 wait complete. 2026-02-25T15:07:26.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.795+0000 7fc1fdacd640 1 librados: shutdown 2026-02-25T15:07:26.805 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2026-02-25T15:07:25.944876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":558688,"kb_used_data":109280,"kb_used_omap":23214,"kb_used_meta":425937,"kb_avail":1509390752,"statfs":{"total":1546188226560,"available":1545616130048,"internally_reserved":0,"allocated":111902720,"data_stored":68980999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23771745,"internal_metadata":436159903},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.147859"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":622,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.729088+0000","last_change":"2026-02-25T15:01:50.952960+0000","last_active":"2026-02-25T15:07:20.729088+0000","last_peered":"2026-02-25T15:07:20.729088+0000","last_clean":"2026-02-25T15:07:20.729088+0000","last_became_active":"2026-02-25T15:01:50.928434+0000","last_became_peered":"2026-02-25T15:01:50.928434+0000","last_unstale":"2026-02-25T15:07:20.729088+0000","last_undegraded":"2026-02-25T15:07:20.729088+0000","last_fullsized":"2026-02-25T15:07:20.729088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:04:36.449802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763811+0000","last_change":"2026-02-25T15:01:51.873447+0000","last_active":"2026-02-25T15:07:22.763811+0000","last_peered":"2026-02-25T15:07:22.763811+0000","last_clean":"2026-02-25T15:07:22.763811+0000","last_became_active":"2026-02-25T15:01:51.860656+0000","last_became_peered":"2026-02-25T15:01:51.860656+0000","last_unstale":"2026-02-25T15:07:22.763811+0000","last_undegraded":"2026-02-25T15:07:22.763811+0000","last_fullsized":"2026-02-25T15:07:22.763811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.276300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.760320+0000","last_change":"2026-02-25T15:01:50.973519+0000","last_active":"2026-02-25T15:07:22.760320+0000","last_peered":"2026-02-25T15:07:22.760320+0000","last_clean":"2026-02-25T15:07:22.760320+0000","last_became_active":"2026-02-25T15:01:50.970996+0000","last_became_peered":"2026-02-25T15:01:50.970996+0000","last_unstale":"2026-02-25T15:07:22.760320+0000","last_undegraded":"2026-02-25T15:07:22.760320+0000","last_fullsized":"2026-02-25T15:07:22.760320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:26:45.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766921+0000","last_change":"2026-02-25T15:01:51.088801+0000","last_active":"2026-02-25T15:07:22.766921+0000","last_peered":"2026-02-25T15:07:22.766921+0000","last_clean":"2026-02-25T15:07:22.766921+0000","last_became_active":"2026-02-25T15:01:50.996313+0000","last_became_peered":"2026-02-25T15:01:50.996313+0000","last_unstale":"2026-02-25T15:07:22.766921+0000","last_undegraded":"2026-02-25T15:07:22.766921+0000","last_fullsized":"2026-02-25T15:07:22.766921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:06:48.841244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,14],"acting":[3,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345212+0000","last_change":"2026-02-25T15:01:50.401182+0000","last_active":"2026-02-25T15:07:21.345212+0000","last_peered":"2026-02-25T15:07:21.345212+0000","last_clean":"2026-02-25T15:07:21.345212+0000","last_became_active":"2026-02-25T15:01:50.387274+0000","last_became_peered":"2026-02-25T15:01:50.387274+0000","last_unstale":"2026-02-25T15:07:21.345212+0000","last_undegraded":"2026-02-25T15:07:21.345212+0000","last_fullsized":"2026-02-25T15:07:21.345212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:55.705403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.344060+0000","last_change":"2026-02-25T15:01:50.841299+0000","last_active":"2026-02-25T15:07:21.344060+0000","last_peered":"2026-02-25T15:07:21.344060+0000","last_clean":"2026-02-25T15:07:21.344060+0000","last_became_active":"2026-02-25T15:01:50.835823+0000","last_became_peered":"2026-02-25T15:01:50.835823+0000","last_unstale":"2026-02-25T15:07:21.344060+0000","last_undegraded":"2026-02-25T15:07:21.344060+0000","last_fullsized":"2026-02-25T15:07:21.344060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:31:50.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.768685+0000","last_change":"2026-02-25T15:01:50.540680+0000","last_active":"2026-02-25T15:07:22.768685+0000","last_peered":"2026-02-25T15:07:22.768685+0000","last_clean":"2026-02-25T15:07:22.768685+0000","last_became_active":"2026-02-25T15:01:50.532546+0000","last_became_peered":"2026-02-25T15:01:50.532546+0000","last_unstale":"2026-02-25T15:07:22.768685+0000","last_undegraded":"2026-02-25T15:07:22.768685+0000","last_fullsized":"2026-02-25T15:07:22.768685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:18:05.725236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.500939+0000","last_change":"2026-02-25T15:01:50.693608+0000","last_active":"2026-02-25T15:07:22.500939+0000","last_peered":"2026-02-25T15:07:22.500939+0000","last_clean":"2026-02-25T15:07:22.500939+0000","last_became_active":"2026-02-25T15:01:50.688197+0000","last_became_peered":"2026-02-25T15:01:50.688197+0000","last_unstale":"2026-02-25T15:07:22.500939+0000","last_undegraded":"2026-02-25T15:07:22.500939+0000","last_fullsized":"2026-02-25T15:07:22.500939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:32:30.363960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.733234+0000","last_change":"2026-02-25T15:01:50.782822+0000","last_active":"2026-02-25T15:07:20.733234+0000","last_peered":"2026-02-25T15:07:20.733234+0000","last_clean":"2026-02-25T15:07:20.733234+0000","last_became_active":"2026-02-25T15:01:50.780343+0000","last_became_peered":"2026-02-25T15:01:50.780343+0000","last_unstale":"2026-02-25T15:07:20.733234+0000","last_undegraded":"2026-02-25T15:07:20.733234+0000","last_fullsized":"2026-02-25T15:07:20.733234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:56:59.786199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345435+0000","last_change":"2026-02-25T15:01:50.885131+0000","last_active":"2026-02-25T15:07:21.345435+0000","last_peered":"2026-02-25T15:07:21.345435+0000","last_clean":"2026-02-25T15:07:21.345435+0000","last_became_active":"2026-02-25T15:01:50.870593+0000","last_became_peered":"2026-02-25T15:01:50.870593+0000","last_unstale":"2026-02-25T15:07:21.345435+0000","last_undegraded":"2026-02-25T15:07:21.345435+0000","last_fullsized":"2026-02-25T15:07:21.345435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:11:54.381039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761032+0000","last_change":"2026-02-25T15:01:51.947696+0000","last_active":"2026-02-25T15:07:22.761032+0000","last_peered":"2026-02-25T15:07:22.761032+0000","last_clean":"2026-02-25T15:07:22.761032+0000","last_became_active":"2026-02-25T15:01:51.925016+0000","last_became_peered":"2026-02-25T15:01:51.925016+0000","last_unstale":"2026-02-25T15:07:22.761032+0000","last_undegraded":"2026-02-25T15:07:22.761032+0000","last_fullsized":"2026-02-25T15:07:22.761032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:22:43.384939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766787+0000","last_change":"2026-02-25T15:01:51.557264+0000","last_active":"2026-02-25T15:07:22.766787+0000","last_peered":"2026-02-25T15:07:22.766787+0000","last_clean":"2026-02-25T15:07:22.766787+0000","last_became_active":"2026-02-25T15:01:51.540535+0000","last_became_peered":"2026-02-25T15:01:51.540535+0000","last_unstale":"2026-02-25T15:07:22.766787+0000","last_undegraded":"2026-02-25T15:07:22.766787+0000","last_fullsized":"2026-02-25T15:07:22.766787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:23:10.989525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":625,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.173211+0000","last_change":"2026-02-25T15:01:50.882445+0000","last_active":"2026-02-25T15:07:22.173211+0000","last_peered":"2026-02-25T15:07:22.173211+0000","last_clean":"2026-02-25T15:07:22.173211+0000","last_became_active":"2026-02-25T15:01:50.877038+0000","last_became_peered":"2026-02-25T15:01:50.877038+0000","last_unstale":"2026-02-25T15:07:22.173211+0000","last_undegraded":"2026-02-25T15:07:22.173211+0000","last_fullsized":"2026-02-25T15:07:22.173211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:40.152080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.762581+0000","last_change":"2026-02-25T15:01:51.252298+0000","last_active":"2026-02-25T15:07:22.762581+0000","last_peered":"2026-02-25T15:07:22.762581+0000","last_clean":"2026-02-25T15:07:22.762581+0000","last_became_active":"2026-02-25T15:01:51.250085+0000","last_became_peered":"2026-02-25T15:01:51.250085+0000","last_unstale":"2026-02-25T15:07:22.762581+0000","last_undegraded":"2026-02-25T15:07:22.762581+0000","last_fullsized":"2026-02-25T15:07:22.762581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:04:10.324827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.495124+0000","last_change":"2026-02-25T15:01:50.457459+0000","last_active":"2026-02-25T15:07:21.495124+0000","last_peered":"2026-02-25T15:07:21.495124+0000","last_clean":"2026-02-25T15:07:21.495124+0000","last_became_active":"2026-02-25T15:01:50.455002+0000","last_became_peered":"2026-02-25T15:01:50.455002+0000","last_unstale":"2026-02-25T15:07:21.495124+0000","last_undegraded":"2026-02-25T15:07:21.495124+0000","last_fullsized":"2026-02-25T15:07:21.495124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:12:16.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.499564+0000","last_change":"2026-02-25T15:01:50.764280+0000","last_active":"2026-02-25T15:07:22.499564+0000","last_peered":"2026-02-25T15:07:22.499564+0000","last_clean":"2026-02-25T15:07:22.499564+0000","last_became_active":"2026-02-25T15:01:50.762167+0000","last_became_peered":"2026-02-25T15:01:50.762167+0000","last_unstale":"2026-02-25T15:07:22.499564+0000","last_undegraded":"2026-02-25T15:07:22.499564+0000","last_fullsized":"2026-02-25T15:07:22.499564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:04:31.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3],"acting":[13,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.756720+0000","last_change":"2026-02-25T15:01:50.542740+0000","last_active":"2026-02-25T15:07:22.756720+0000","last_peered":"2026-02-25T15:07:22.756720+0000","last_clean":"2026-02-25T15:07:22.756720+0000","last_became_active":"2026-02-25T15:01:50.536997+0000","last_became_peered":"2026-02-25T15:01:50.536997+0000","last_unstale":"2026-02-25T15:07:22.756720+0000","last_undegraded":"2026-02-25T15:07:22.756720+0000","last_fullsized":"2026-02-25T15:07:22.756720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:40:49.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.351419+0000","last_change":"2026-02-25T15:01:50.446794+0000","last_active":"2026-02-25T15:07:21.351419+0000","last_peered":"2026-02-25T15:07:21.351419+0000","last_clean":"2026-02-25T15:07:21.351419+0000","last_became_active":"2026-02-25T15:01:50.444694+0000","last_became_peered":"2026-02-25T15:01:50.444694+0000","last_unstale":"2026-02-25T15:07:21.351419+0000","last_undegraded":"2026-02-25T15:07:21.351419+0000","last_fullsized":"2026-02-25T15:07:21.351419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:11:26.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.747184+0000","last_change":"2026-02-25T15:01:51.582040+0000","last_active":"2026-02-25T15:07:21.747184+0000","last_peered":"2026-02-25T15:07:21.747184+0000","last_clean":"2026-02-25T15:07:21.747184+0000","last_became_active":"2026-02-25T15:01:51.576775+0000","last_became_peered":"2026-02-25T15:01:51.576775+0000","last_unstale":"2026-02-25T15:07:21.747184+0000","last_undegraded":"2026-02-25T15:07:21.747184+0000","last_fullsized":"2026-02-25T15:07:21.747184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:10:05.577790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.735858+0000","last_change":"2026-02-25T15:01:51.716484+0000","last_active":"2026-02-25T15:07:20.735858+0000","last_peered":"2026-02-25T15:07:20.735858+0000","last_clean":"2026-02-25T15:07:20.735858+0000","last_became_active":"2026-02-25T15:01:51.713882+0000","last_became_peered":"2026-02-25T15:01:51.713882+0000","last_unstale":"2026-02-25T15:07:20.735858+0000","last_undegraded":"2026-02-25T15:07:20.735858+0000","last_fullsized":"2026-02-25T15:07:20.735858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:05.150346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,14],"acting":[7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343261+0000","last_change":"2026-02-25T15:01:50.434699+0000","last_active":"2026-02-25T15:07:21.343261+0000","last_peered":"2026-02-25T15:07:21.343261+0000","last_clean":"2026-02-25T15:07:21.343261+0000","last_became_active":"2026-02-25T15:01:50.432641+0000","last_became_peered":"2026-02-25T15:01:50.432641+0000","last_unstale":"2026-02-25T15:07:21.343261+0000","last_undegraded":"2026-02-25T15:07:21.343261+0000","last_fullsized":"2026-02-25T15:07:21.343261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:59:56.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343573+0000","last_change":"2026-02-25T15:01:50.372550+0000","last_active":"2026-02-25T15:07:21.343573+0000","last_peered":"2026-02-25T15:07:21.343573+0000","last_clean":"2026-02-25T15:07:21.343573+0000","last_became_active":"2026-02-25T15:01:50.366512+0000","last_became_peered":"2026-02-25T15:01:50.366512+0000","last_unstale":"2026-02-25T15:07:21.343573+0000","last_undegraded":"2026-02-25T15:07:21.343573+0000","last_fullsized":"2026-02-25T15:07:21.343573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:11:04.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.764190+0000","last_change":"2026-02-25T15:01:50.801667+0000","last_active":"2026-02-25T15:07:22.764190+0000","last_peered":"2026-02-25T15:07:22.764190+0000","last_clean":"2026-02-25T15:07:22.764190+0000","last_became_active":"2026-02-25T15:01:50.798788+0000","last_became_peered":"2026-02-25T15:01:50.798788+0000","last_unstale":"2026-02-25T15:07:22.764190+0000","last_undegraded":"2026-02-25T15:07:22.764190+0000","last_fullsized":"2026-02-25T15:07:22.764190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:05:57.793192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.765661+0000","last_change":"2026-02-25T15:01:51.520848+0000","last_active":"2026-02-25T15:07:22.765661+0000","last_peered":"2026-02-25T15:07:22.765661+0000","last_clean":"2026-02-25T15:07:22.765661+0000","last_became_active":"2026-02-25T15:01:51.516175+0000","last_became_peered":"2026-02-25T15:01:51.516175+0000","last_unstale":"2026-02-25T15:07:22.765661+0000","last_undegraded":"2026-02-25T15:07:22.765661+0000","last_fullsized":"2026-02-25T15:07:22.765661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:36:33.921739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,6],"acting":[12,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.734146+0000","last_change":"2026-02-25T15:01:51.024149+0000","last_active":"2026-02-25T15:07:20.734146+0000","last_peered":"2026-02-25T15:07:20.734146+0000","last_clean":"2026-02-25T15:07:20.734146+0000","last_became_active":"2026-02-25T15:01:51.015292+0000","last_became_peered":"2026-02-25T15:01:51.015292+0000","last_unstale":"2026-02-25T15:07:20.734146+0000","last_undegraded":"2026-02-25T15:07:20.734146+0000","last_fullsized":"2026-02-25T15:07:20.734146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:06:39.316850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.353767+0000","last_change":"2026-02-25T15:01:51.625041+0000","last_active":"2026-02-25T15:07:21.353767+0000","last_peered":"2026-02-25T15:07:21.353767+0000","last_clean":"2026-02-25T15:07:21.353767+0000","last_became_active":"2026-02-25T15:01:51.622021+0000","last_became_peered":"2026-02-25T15:01:51.622021+0000","last_unstale":"2026-02-25T15:07:21.353767+0000","last_undegraded":"2026-02-25T15:07:21.353767+0000","last_fullsized":"2026-02-25T15:07:21.353767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:32:06.115017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.354792+0000","last_change":"2026-02-25T15:01:50.541523+0000","last_active":"2026-02-25T15:07:21.354792+0000","last_peered":"2026-02-25T15:07:21.354792+0000","last_clean":"2026-02-25T15:07:21.354792+0000","last_became_active":"2026-02-25T15:01:50.499499+0000","last_became_peered":"2026-02-25T15:01:50.499499+0000","last_unstale":"2026-02-25T15:07:21.354792+0000","last_undegraded":"2026-02-25T15:07:21.354792+0000","last_fullsized":"2026-02-25T15:07:21.354792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:45.307471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,12],"acting":[8,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.352813+0000","last_change":"2026-02-25T15:01:50.293543+0000","last_active":"2026-02-25T15:07:21.352813+0000","last_peered":"2026-02-25T15:07:21.352813+0000","last_clean":"2026-02-25T15:07:21.352813+0000","last_became_active":"2026-02-25T15:01:50.281495+0000","last_became_peered":"2026-02-25T15:01:50.281495+0000","last_unstale":"2026-02-25T15:07:21.352813+0000","last_undegraded":"2026-02-25T15:07:21.352813+0000","last_fullsized":"2026-02-25T15:07:21.352813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:43:35.579264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.1","version":"34'11","reported_seq":653,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763900+0000","last_change":"2026-02-25T15:01:50.681438+0000","last_active":"2026-02-25T15:07:22.763900+0000","last_peered":"2026-02-25T15:07:22.763900+0000","last_clean":"2026-02-25T15:07:22.763900+0000","last_became_active":"2026-02-25T15:01:50.639260+0000","last_became_peered":"2026-02-25T15:01:50.639260+0000","last_unstale":"2026-02-25T15:07:22.763900+0000","last_undegraded":"2026-02-25T15:07:22.763900+0000","last_fullsized":"2026-02-25T15:07:22.763900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:53:25.658215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761696+0000","last_change":"2026-02-25T15:01:50.710810+0000","last_active":"2026-02-25T15:07:22.761696+0000","last_peered":"2026-02-25T15:07:22.761696+0000","last_clean":"2026-02-25T15:07:22.761696+0000","last_became_active":"2026-02-25T15:01:50.708573+0000","last_became_peered":"2026-02-25T15:01:50.708573+0000","last_unstale":"2026-02-25T15:07:22.761696+0000","last_undegraded":"2026-02-25T15:07:22.761696+0000","last_fullsized":"2026-02-25T15:07:22.761696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:53:45.894951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":620,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.484173+0000","last_change":"2026-02-25T15:01:51.593638+0000","last_active":"2026-02-25T15:07:22.484173+0000","last_peered":"2026-02-25T15:07:22.484173+0000","last_clean":"2026-02-25T15:07:22.484173+0000","last_became_active":"2026-02-25T15:01:51.576151+0000","last_became_peered":"2026-02-25T15:01:51.576151+0000","last_unstale":"2026-02-25T15:07:22.484173+0000","last_undegraded":"2026-02-25T15:07:22.484173+0000","last_fullsized":"2026-02-25T15:07:22.484173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:22:41.062323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.346771+0000","last_change":"2026-02-25T15:01:50.715301+0000","last_active":"2026-02-25T15:07:21.346771+0000","last_peered":"2026-02-25T15:07:21.346771+0000","last_clean":"2026-02-25T15:07:21.346771+0000","last_became_active":"2026-02-25T15:01:50.713136+0000","last_became_peered":"2026-02-25T15:01:50.713136+0000","last_unstale":"2026-02-25T15:07:21.346771+0000","last_undegraded":"2026-02-25T15:07:21.346771+0000","last_fullsized":"2026-02-25T15:07:21.346771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:17:44.395283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":640,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.174002+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:07:22.174002+0000","last_peered":"2026-02-25T15:07:22.174002+0000","last_clean":"2026-02-25T15:07:22.174002+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:07:22.174002+0000","last_undegraded":"2026-02-25T15:07:22.174002+0000","last_fullsized":"2026-02-25T15:07:22.174002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":642,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766776+0000","last_change":"2026-02-25T15:01:17.810911+0000","last_active":"2026-02-25T15:07:22.766776+0000","last_peered":"2026-02-25T15:07:22.766776+0000","last_clean":"2026-02-25T15:07:22.766776+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:07:22.766776+0000","last_undegraded":"2026-02-25T15:07:22.766776+0000","last_fullsized":"2026-02-25T15:07:22.766776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:24:11.882619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.482458+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:07:22.482458+0000","last_peered":"2026-02-25T15:07:22.482458+0000","last_clean":"2026-02-25T15:07:22.482458+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:07:22.482458+0000","last_undegraded":"2026-02-25T15:07:22.482458+0000","last_fullsized":"2026-02-25T15:07:22.482458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:40:33.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.485965+0000","last_change":"2026-02-25T15:01:17.750860+0000","last_active":"2026-02-25T15:07:22.485965+0000","last_peered":"2026-02-25T15:07:22.485965+0000","last_clean":"2026-02-25T15:07:22.485965+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:07:22.485965+0000","last_undegraded":"2026-02-25T15:07:22.485965+0000","last_fullsized":"2026-02-25T15:07:22.485965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:42:01.069031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":642,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.170343+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:07:22.170343+0000","last_peered":"2026-02-25T15:07:22.170343+0000","last_clean":"2026-02-25T15:07:22.170343+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:07:22.170343+0000","last_undegraded":"2026-02-25T15:07:22.170343+0000","last_fullsized":"2026-02-25T15:07:22.170343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":638,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.744838+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:07:21.744838+0000","last_peered":"2026-02-25T15:07:21.744838+0000","last_clean":"2026-02-25T15:07:21.744838+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:07:21.744838+0000","last_undegraded":"2026-02-25T15:07:21.744838+0000","last_fullsized":"2026-02-25T15:07:21.744838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":639,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.348493+0000","last_change":"2026-02-25T15:01:17.333599+0000","last_active":"2026-02-25T15:07:21.348493+0000","last_peered":"2026-02-25T15:07:21.348493+0000","last_clean":"2026-02-25T15:07:21.348493+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:07:21.348493+0000","last_undegraded":"2026-02-25T15:07:21.348493+0000","last_fullsized":"2026-02-25T15:07:21.348493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:49:45.844553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":641,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.172758+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:07:22.172758+0000","last_peered":"2026-02-25T15:07:22.172758+0000","last_clean":"2026-02-25T15:07:22.172758+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:07:22.172758+0000","last_undegraded":"2026-02-25T15:07:22.172758+0000","last_fullsized":"2026-02-25T15:07:22.172758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":685,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.726590+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:07:20.726590+0000","last_peered":"2026-02-25T15:07:20.726590+0000","last_clean":"2026-02-25T15:07:20.726590+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:07:20.726590+0000","last_undegraded":"2026-02-25T15:07:20.726590+0000","last_fullsized":"2026-02-25T15:07:20.726590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":163,"kb_used_meta":26780,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167305,"internal_metadata":27423351},"hb_peers":[0,1,2,3,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34216,"kb_used_data":7256,"kb_used_omap":158,"kb_used_meta":26785,"kb_avail":94337624,"statfs":{"total":96636764160,"available":96601726976,"internally_reserved":0,"allocated":7430144,"data_stored":4731627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161981,"internal_metadata":27428675},"hb_peers":[0,1,2,4,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189804,"internal_metadata":27400852},"hb_peers":[0,1,3,4,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3088058,"internal_metadata":24502598},"hb_peers":[1,3,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280589,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2509,"kb_used_meta":24434,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2569932,"internal_metadata":25020724},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":2415,"kb_used_meta":24528,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2473663,"internal_metadata":25116993},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2463,"kb_used_meta":24480,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2522856,"internal_metadata":25067800},"hb_peers":[1,2,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214866,"internal_metadata":27375790},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34180,"kb_used_data":7220,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94337660,"statfs":{"total":96636764160,"available":96601763840,"internally_reserved":0,"allocated":7393280,"data_stored":4710204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208902,"internal_metadata":27381754},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":3013,"kb_used_meta":23930,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3085464,"internal_metadata":24505192},"hb_peers":[0,1,2,3,4,6,7,8,9,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":106,"kb_used_meta":26837,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108705,"internal_metadata":27481951},"hb_peers":[0,1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":6772,"kb_used_omap":3014,"kb_used_meta":41977,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3086891,"internal_metadata":42984917},"hb_peers":[1,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":2550,"kb_used_meta":24393,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2612076,"internal_metadata":24978580},"hb_peers":[0,1,2,3,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57481,"internal_metadata":27533175},"hb_peers":[1,3,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":4260236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084764,"internal_metadata":24505892},"hb_peers":[0,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138997,"internal_metadata":27451659},"hb_peers":[0,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:07:26.809 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 10 monclient: get_monmap_and_config 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 10 monclient: build_initial_monmap 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 10 monclient: monmap: 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:26.877914+0000 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:26.877914+0000 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:26.879 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.880 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:26.880 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:26.880 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:26.880 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 1 Processor -- start 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 1 -- start start 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.877+0000 7f03292e8640 10 monclient: init 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:26.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-b con 0x7f0324058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-a con 0x7f03240b0410 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-c con 0x7f03241626a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03241655c0 con 0x7f03240b0410 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03240b12b0 con 0x7f0324058da0 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03240b1590 con 0x7f03241626a0 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03292e8640 10 monclient(hunting): authenticate will time out at 3390.470297s 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03227fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f03240b0410 0x7f0324164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50426/0 (socket says 10.20.193.21:50426) 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.878+0000 7f03227fc640 1 -- 10.20.193.21:0/442100545 learned_addr learned my addr 10.20.193.21:0/442100545 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.879+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225086978 0 0) 0x7f03241655c0 con 0x7f03240b0410 2026-02-25T15:07:26.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.879+0000 7f0321ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.879+0000 7f0321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.879+0000 7f0321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.879+0000 7f0321ffb640 10 monclient(hunting): my global_id is 28146 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0310003610 con 0x7f03240b0410 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2561060571 0 0) 0x7f03240b12b0 con 0x7f0324058da0 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): my global_id is 29119 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03241655c0 con 0x7f0324058da0 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206957978 0 0) 0x7f03240b1590 con 0x7f03241626a0 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 10 monclient(hunting): my global_id is 30773 2026-02-25T15:07:26.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.880+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03240b12b0 con 0x7f03241626a0 2026-02-25T15:07:26.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2177322086 0 0) 0x7f03241655c0 con 0x7f0324058da0 2026-02-25T15:07:26.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 >> v1:10.20.193.68:6789/0 conn(0x7f03241626a0 legacy=0x7f03241c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 >> v1:10.20.193.21:6789/0 conn(0x7f03240b0410 legacy=0x7f0324164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 monclient: found mon.noname-b 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03240b1870 con 0x7f0324058da0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0318002df0 con 0x7f0324058da0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:26.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f0321ffb640 10 monclient: dump: 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f03292e8640 5 monclient: authenticate success, global_id 29119 2026-02-25T15:07:26.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.881+0000 7f03292e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0318002fc0 con 0x7f0324058da0 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 1 -- 10.20.193.21:0/442100545 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0318003400 con 0x7f0324058da0 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f0321ffb640 10 monclient: dump: 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.892 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f03292e8640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f03292e8640 4 set_mon_vals no callback set 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f03292e8640 10 monclient: shutdown 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f03292e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.882+0000 7f03292e8640 1 -- 10.20.193.21:0/442100545 >> v1:10.20.193.31:6789/0 conn(0x7f0324058da0 legacy=0x7f03241647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 -- 10.20.193.21:0/442100545 shutdown_connections 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 -- 10.20.193.21:0/442100545 >> 10.20.193.21:0/442100545 conn(0x7f03240b65f0 msgr2=0x7f03240b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:26.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 -- 10.20.193.21:0/442100545 shutdown_connections 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 -- 10.20.193.21:0/442100545 wait complete. 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 10 monclient: build_initial_monmap 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 10 monclient: monmap: 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:26.894 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 librados: starting msgr at 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 librados: starting objecter 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 Processor -- start 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 -- start start 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 librados: setting wanted keys 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 1 librados: calling monclient init 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.883+0000 7f03292e8640 10 monclient: init 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-a con 0x7f0324058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:26.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-b con 0x7f03240b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient(hunting): picked mon.noname-c con 0x7f03241626a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032414c440 con 0x7f0324058da0 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032414be80 con 0x7f03240b0410 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032414c160 con 0x7f03241626a0 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03292e8640 10 monclient(hunting): authenticate will time out at 3390.476281s 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03227fc640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f03240b0410 0x7f03240569e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:55532/0 (socket says 10.20.193.21:55532) 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03227fc640 1 -- 10.20.193.21:0/507051263 learned_addr learned my addr 10.20.193.21:0/507051263 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03037fe640 10 client.?.objecter ms_handle_connect 0x7f03240b0410 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03037fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03037fe640 10 client.?.objecter ms_handle_connect 0x7f03241626a0 2026-02-25T15:07:26.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.884+0000 7f03037fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 client.?.objecter ms_handle_connect 0x7f0324058da0 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509173492 0 0) 0x7f032414c160 con 0x7f03241626a0 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): my global_id is 30776 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f0003610 con 0x7f03241626a0 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951746330 0 0) 0x7f032414be80 con 0x7f03240b0410 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 10 monclient(hunting): my global_id is 29122 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.885+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f032414c160 con 0x7f03240b0410 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761814033 0 0) 0x7f032414c440 con 0x7f0324058da0 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 10 monclient(hunting): my global_id is 28149 2026-02-25T15:07:26.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.886+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f032414be80 con 0x7f0324058da0 2026-02-25T15:07:26.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1157477493 0 0) 0x7f032414c160 con 0x7f03240b0410 2026-02-25T15:07:26.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f032414c440 con 0x7f03240b0410 2026-02-25T15:07:26.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f030c0030b0 con 0x7f03240b0410 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): dump: 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.901 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 166185767 0 0) 0x7f02f0003610 con 0x7f03241626a0 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f032414c160 con 0x7f03241626a0 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0314003330 con 0x7f03241626a0 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): dump: 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.902 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4014527586 0 0) 0x7f032414be80 con 0x7f0324058da0 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02f0003610 con 0x7f0324058da0 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0318003310 con 0x7f0324058da0 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:26.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.888+0000 7f03037fe640 10 monclient(hunting): dump: 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3013866914 0 0) 0x7f032414c160 con 0x7f03241626a0 2026-02-25T15:07:26.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 >> v1:10.20.193.31:6789/0 conn(0x7f03240b0410 legacy=0x7f03240569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 >> v1:10.20.193.21:6789/0 conn(0x7f0324058da0 legacy=0x7f032414b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 1 monclient: found mon.c 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03241480f0 con 0x7f03241626a0 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 5 monclient: authenticate success, global_id 30776 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 10 monclient: _renew_subs 2026-02-25T15:07:26.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03241483d0 con 0x7f03241626a0 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 10 client.30776.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 10 monclient: _renew_subs 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03240570f0 con 0x7f03241626a0 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.889+0000 7f03292e8640 1 librados: init done 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.890+0000 7f03292e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.890+0000 7f03292e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.890+0000 7f03292e8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:26.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.890+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0324057380 con 0x7f03241626a0 2026-02-25T15:07:26.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0314003860 con 0x7f03241626a0 2026-02-25T15:07:26.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:26.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f0314003c20 con 0x7f03241626a0 2026-02-25T15:07:26.984 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03217fa640 4 set_mon_vals no callback set 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.982+0000 7f03037fe640 10 monclient: dump: 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:26.985 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:26.986 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.983+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f031401d100 con 0x7f03241626a0 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.983+0000 7f0322ffd640 10 monclient: get_auth_request con 0x7f02f007a110 auth_method 0 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.983+0000 7f03037fe640 10 client.30776.objecter ms_handle_connect 0x7f02f007a110 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.984+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f0314094a90 con 0x7f03241626a0 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.984+0000 7f03037fe640 10 client.30776.objecter ms_dispatch2 0x7f0324000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.984+0000 7f03037fe640 3 client.30776.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.984+0000 7f03037fe640 3 client.30776.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:26.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.984+0000 7f03037fe640 20 client.30776.objecter dump_active .. 0 homeless 2026-02-25T15:07:26.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.986+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f031405e3f0 con 0x7f03241626a0 2026-02-25T15:07:26.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.986+0000 7f03037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:26.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:26.986+0000 7f03037fe640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:27.094 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.093+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03240b2a40 con 0x7f02f007a110 2026-02-25T15:07:27.096 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.094+0000 7f03037fe640 1 -- 10.20.193.21:0/507051263 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125409 (unknown 2965378022 0 3746370452) 0x7f0318007860 con 0x7f02f007a110 2026-02-25T15:07:27.097 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:27.098 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 10 librados: watch_flush enter 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 10 librados: watch_flush exit 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 20 client.30776.objecter shutdown clearing up homeless session... 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 10 client.30776.objecter successfully canceled tick 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 >> v1:10.20.193.72:6800/2463505645 conn(0x7f02f007a110 legacy=0x7f02f009a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 10 monclient: shutdown 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:27.100 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 >> v1:10.20.193.68:6789/0 conn(0x7f03241626a0 legacy=0x7f032413c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 shutdown_connections 2026-02-25T15:07:27.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 >> 10.20.193.21:0/507051263 conn(0x7f03240b65f0 msgr2=0x7f03240afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:27.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 shutdown_connections 2026-02-25T15:07:27.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 -- 10.20.193.21:0/507051263 wait complete. 2026-02-25T15:07:27.101 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.096+0000 7f03292e8640 1 librados: shutdown 2026-02-25T15:07:27.106 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2026-02-25T15:07:25.944876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":558688,"kb_used_data":109280,"kb_used_omap":23214,"kb_used_meta":425937,"kb_avail":1509390752,"statfs":{"total":1546188226560,"available":1545616130048,"internally_reserved":0,"allocated":111902720,"data_stored":68980999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23771745,"internal_metadata":436159903},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.147859"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":622,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.729088+0000","last_change":"2026-02-25T15:01:50.952960+0000","last_active":"2026-02-25T15:07:20.729088+0000","last_peered":"2026-02-25T15:07:20.729088+0000","last_clean":"2026-02-25T15:07:20.729088+0000","last_became_active":"2026-02-25T15:01:50.928434+0000","last_became_peered":"2026-02-25T15:01:50.928434+0000","last_unstale":"2026-02-25T15:07:20.729088+0000","last_undegraded":"2026-02-25T15:07:20.729088+0000","last_fullsized":"2026-02-25T15:07:20.729088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:04:36.449802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763811+0000","last_change":"2026-02-25T15:01:51.873447+0000","last_active":"2026-02-25T15:07:22.763811+0000","last_peered":"2026-02-25T15:07:22.763811+0000","last_clean":"2026-02-25T15:07:22.763811+0000","last_became_active":"2026-02-25T15:01:51.860656+0000","last_became_peered":"2026-02-25T15:01:51.860656+0000","last_unstale":"2026-02-25T15:07:22.763811+0000","last_undegraded":"2026-02-25T15:07:22.763811+0000","last_fullsized":"2026-02-25T15:07:22.763811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.276300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.760320+0000","last_change":"2026-02-25T15:01:50.973519+0000","last_active":"2026-02-25T15:07:22.760320+0000","last_peered":"2026-02-25T15:07:22.760320+0000","last_clean":"2026-02-25T15:07:22.760320+0000","last_became_active":"2026-02-25T15:01:50.970996+0000","last_became_peered":"2026-02-25T15:01:50.970996+0000","last_unstale":"2026-02-25T15:07:22.760320+0000","last_undegraded":"2026-02-25T15:07:22.760320+0000","last_fullsized":"2026-02-25T15:07:22.760320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:26:45.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766921+0000","last_change":"2026-02-25T15:01:51.088801+0000","last_active":"2026-02-25T15:07:22.766921+0000","last_peered":"2026-02-25T15:07:22.766921+0000","last_clean":"2026-02-25T15:07:22.766921+0000","last_became_active":"2026-02-25T15:01:50.996313+0000","last_became_peered":"2026-02-25T15:01:50.996313+0000","last_unstale":"2026-02-25T15:07:22.766921+0000","last_undegraded":"2026-02-25T15:07:22.766921+0000","last_fullsized":"2026-02-25T15:07:22.766921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:06:48.841244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,14],"acting":[3,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345212+0000","last_change":"2026-02-25T15:01:50.401182+0000","last_active":"2026-02-25T15:07:21.345212+0000","last_peered":"2026-02-25T15:07:21.345212+0000","last_clean":"2026-02-25T15:07:21.345212+0000","last_became_active":"2026-02-25T15:01:50.387274+0000","last_became_peered":"2026-02-25T15:01:50.387274+0000","last_unstale":"2026-02-25T15:07:21.345212+0000","last_undegraded":"2026-02-25T15:07:21.345212+0000","last_fullsized":"2026-02-25T15:07:21.345212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:55.705403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.344060+0000","last_change":"2026-02-25T15:01:50.841299+0000","last_active":"2026-02-25T15:07:21.344060+0000","last_peered":"2026-02-25T15:07:21.344060+0000","last_clean":"2026-02-25T15:07:21.344060+0000","last_became_active":"2026-02-25T15:01:50.835823+0000","last_became_peered":"2026-02-25T15:01:50.835823+0000","last_unstale":"2026-02-25T15:07:21.344060+0000","last_undegraded":"2026-02-25T15:07:21.344060+0000","last_fullsized":"2026-02-25T15:07:21.344060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:31:50.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.768685+0000","last_change":"2026-02-25T15:01:50.540680+0000","last_active":"2026-02-25T15:07:22.768685+0000","last_peered":"2026-02-25T15:07:22.768685+0000","last_clean":"2026-02-25T15:07:22.768685+0000","last_became_active":"2026-02-25T15:01:50.532546+0000","last_became_peered":"2026-02-25T15:01:50.532546+0000","last_unstale":"2026-02-25T15:07:22.768685+0000","last_undegraded":"2026-02-25T15:07:22.768685+0000","last_fullsized":"2026-02-25T15:07:22.768685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:18:05.725236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.500939+0000","last_change":"2026-02-25T15:01:50.693608+0000","last_active":"2026-02-25T15:07:22.500939+0000","last_peered":"2026-02-25T15:07:22.500939+0000","last_clean":"2026-02-25T15:07:22.500939+0000","last_became_active":"2026-02-25T15:01:50.688197+0000","last_became_peered":"2026-02-25T15:01:50.688197+0000","last_unstale":"2026-02-25T15:07:22.500939+0000","last_undegraded":"2026-02-25T15:07:22.500939+0000","last_fullsized":"2026-02-25T15:07:22.500939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:32:30.363960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.733234+0000","last_change":"2026-02-25T15:01:50.782822+0000","last_active":"2026-02-25T15:07:20.733234+0000","last_peered":"2026-02-25T15:07:20.733234+0000","last_clean":"2026-02-25T15:07:20.733234+0000","last_became_active":"2026-02-25T15:01:50.780343+0000","last_became_peered":"2026-02-25T15:01:50.780343+0000","last_unstale":"2026-02-25T15:07:20.733234+0000","last_undegraded":"2026-02-25T15:07:20.733234+0000","last_fullsized":"2026-02-25T15:07:20.733234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:56:59.786199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345435+0000","last_change":"2026-02-25T15:01:50.885131+0000","last_active":"2026-02-25T15:07:21.345435+0000","last_peered":"2026-02-25T15:07:21.345435+0000","last_clean":"2026-02-25T15:07:21.345435+0000","last_became_active":"2026-02-25T15:01:50.870593+0000","last_became_peered":"2026-02-25T15:01:50.870593+0000","last_unstale":"2026-02-25T15:07:21.345435+0000","last_undegraded":"2026-02-25T15:07:21.345435+0000","last_fullsized":"2026-02-25T15:07:21.345435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:11:54.381039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761032+0000","last_change":"2026-02-25T15:01:51.947696+0000","last_active":"2026-02-25T15:07:22.761032+0000","last_peered":"2026-02-25T15:07:22.761032+0000","last_clean":"2026-02-25T15:07:22.761032+0000","last_became_active":"2026-02-25T15:01:51.925016+0000","last_became_peered":"2026-02-25T15:01:51.925016+0000","last_unstale":"2026-02-25T15:07:22.761032+0000","last_undegraded":"2026-02-25T15:07:22.761032+0000","last_fullsized":"2026-02-25T15:07:22.761032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:22:43.384939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766787+0000","last_change":"2026-02-25T15:01:51.557264+0000","last_active":"2026-02-25T15:07:22.766787+0000","last_peered":"2026-02-25T15:07:22.766787+0000","last_clean":"2026-02-25T15:07:22.766787+0000","last_became_active":"2026-02-25T15:01:51.540535+0000","last_became_peered":"2026-02-25T15:01:51.540535+0000","last_unstale":"2026-02-25T15:07:22.766787+0000","last_undegraded":"2026-02-25T15:07:22.766787+0000","last_fullsized":"2026-02-25T15:07:22.766787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:23:10.989525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":625,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.173211+0000","last_change":"2026-02-25T15:01:50.882445+0000","last_active":"2026-02-25T15:07:22.173211+0000","last_peered":"2026-02-25T15:07:22.173211+0000","last_clean":"2026-02-25T15:07:22.173211+0000","last_became_active":"2026-02-25T15:01:50.877038+0000","last_became_peered":"2026-02-25T15:01:50.877038+0000","last_unstale":"2026-02-25T15:07:22.173211+0000","last_undegraded":"2026-02-25T15:07:22.173211+0000","last_fullsized":"2026-02-25T15:07:22.173211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:40.152080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.762581+0000","last_change":"2026-02-25T15:01:51.252298+0000","last_active":"2026-02-25T15:07:22.762581+0000","last_peered":"2026-02-25T15:07:22.762581+0000","last_clean":"2026-02-25T15:07:22.762581+0000","last_became_active":"2026-02-25T15:01:51.250085+0000","last_became_peered":"2026-02-25T15:01:51.250085+0000","last_unstale":"2026-02-25T15:07:22.762581+0000","last_undegraded":"2026-02-25T15:07:22.762581+0000","last_fullsized":"2026-02-25T15:07:22.762581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:04:10.324827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.495124+0000","last_change":"2026-02-25T15:01:50.457459+0000","last_active":"2026-02-25T15:07:21.495124+0000","last_peered":"2026-02-25T15:07:21.495124+0000","last_clean":"2026-02-25T15:07:21.495124+0000","last_became_active":"2026-02-25T15:01:50.455002+0000","last_became_peered":"2026-02-25T15:01:50.455002+0000","last_unstale":"2026-02-25T15:07:21.495124+0000","last_undegraded":"2026-02-25T15:07:21.495124+0000","last_fullsized":"2026-02-25T15:07:21.495124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:12:16.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.499564+0000","last_change":"2026-02-25T15:01:50.764280+0000","last_active":"2026-02-25T15:07:22.499564+0000","last_peered":"2026-02-25T15:07:22.499564+0000","last_clean":"2026-02-25T15:07:22.499564+0000","last_became_active":"2026-02-25T15:01:50.762167+0000","last_became_peered":"2026-02-25T15:01:50.762167+0000","last_unstale":"2026-02-25T15:07:22.499564+0000","last_undegraded":"2026-02-25T15:07:22.499564+0000","last_fullsized":"2026-02-25T15:07:22.499564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:04:31.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3],"acting":[13,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.756720+0000","last_change":"2026-02-25T15:01:50.542740+0000","last_active":"2026-02-25T15:07:22.756720+0000","last_peered":"2026-02-25T15:07:22.756720+0000","last_clean":"2026-02-25T15:07:22.756720+0000","last_became_active":"2026-02-25T15:01:50.536997+0000","last_became_peered":"2026-02-25T15:01:50.536997+0000","last_unstale":"2026-02-25T15:07:22.756720+0000","last_undegraded":"2026-02-25T15:07:22.756720+0000","last_fullsized":"2026-02-25T15:07:22.756720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:40:49.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.351419+0000","last_change":"2026-02-25T15:01:50.446794+0000","last_active":"2026-02-25T15:07:21.351419+0000","last_peered":"2026-02-25T15:07:21.351419+0000","last_clean":"2026-02-25T15:07:21.351419+0000","last_became_active":"2026-02-25T15:01:50.444694+0000","last_became_peered":"2026-02-25T15:01:50.444694+0000","last_unstale":"2026-02-25T15:07:21.351419+0000","last_undegraded":"2026-02-25T15:07:21.351419+0000","last_fullsized":"2026-02-25T15:07:21.351419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:11:26.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.747184+0000","last_change":"2026-02-25T15:01:51.582040+0000","last_active":"2026-02-25T15:07:21.747184+0000","last_peered":"2026-02-25T15:07:21.747184+0000","last_clean":"2026-02-25T15:07:21.747184+0000","last_became_active":"2026-02-25T15:01:51.576775+0000","last_became_peered":"2026-02-25T15:01:51.576775+0000","last_unstale":"2026-02-25T15:07:21.747184+0000","last_undegraded":"2026-02-25T15:07:21.747184+0000","last_fullsized":"2026-02-25T15:07:21.747184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:10:05.577790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.735858+0000","last_change":"2026-02-25T15:01:51.716484+0000","last_active":"2026-02-25T15:07:20.735858+0000","last_peered":"2026-02-25T15:07:20.735858+0000","last_clean":"2026-02-25T15:07:20.735858+0000","last_became_active":"2026-02-25T15:01:51.713882+0000","last_became_peered":"2026-02-25T15:01:51.713882+0000","last_unstale":"2026-02-25T15:07:20.735858+0000","last_undegraded":"2026-02-25T15:07:20.735858+0000","last_fullsized":"2026-02-25T15:07:20.735858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:05.150346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,14],"acting":[7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343261+0000","last_change":"2026-02-25T15:01:50.434699+0000","last_active":"2026-02-25T15:07:21.343261+0000","last_peered":"2026-02-25T15:07:21.343261+0000","last_clean":"2026-02-25T15:07:21.343261+0000","last_became_active":"2026-02-25T15:01:50.432641+0000","last_became_peered":"2026-02-25T15:01:50.432641+0000","last_unstale":"2026-02-25T15:07:21.343261+0000","last_undegraded":"2026-02-25T15:07:21.343261+0000","last_fullsized":"2026-02-25T15:07:21.343261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:59:56.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343573+0000","last_change":"2026-02-25T15:01:50.372550+0000","last_active":"2026-02-25T15:07:21.343573+0000","last_peered":"2026-02-25T15:07:21.343573+0000","last_clean":"2026-02-25T15:07:21.343573+0000","last_became_active":"2026-02-25T15:01:50.366512+0000","last_became_peered":"2026-02-25T15:01:50.366512+0000","last_unstale":"2026-02-25T15:07:21.343573+0000","last_undegraded":"2026-02-25T15:07:21.343573+0000","last_fullsized":"2026-02-25T15:07:21.343573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:11:04.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.764190+0000","last_change":"2026-02-25T15:01:50.801667+0000","last_active":"2026-02-25T15:07:22.764190+0000","last_peered":"2026-02-25T15:07:22.764190+0000","last_clean":"2026-02-25T15:07:22.764190+0000","last_became_active":"2026-02-25T15:01:50.798788+0000","last_became_peered":"2026-02-25T15:01:50.798788+0000","last_unstale":"2026-02-25T15:07:22.764190+0000","last_undegraded":"2026-02-25T15:07:22.764190+0000","last_fullsized":"2026-02-25T15:07:22.764190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:05:57.793192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.765661+0000","last_change":"2026-02-25T15:01:51.520848+0000","last_active":"2026-02-25T15:07:22.765661+0000","last_peered":"2026-02-25T15:07:22.765661+0000","last_clean":"2026-02-25T15:07:22.765661+0000","last_became_active":"2026-02-25T15:01:51.516175+0000","last_became_peered":"2026-02-25T15:01:51.516175+0000","last_unstale":"2026-02-25T15:07:22.765661+0000","last_undegraded":"2026-02-25T15:07:22.765661+0000","last_fullsized":"2026-02-25T15:07:22.765661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:36:33.921739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,6],"acting":[12,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.734146+0000","last_change":"2026-02-25T15:01:51.024149+0000","last_active":"2026-02-25T15:07:20.734146+0000","last_peered":"2026-02-25T15:07:20.734146+0000","last_clean":"2026-02-25T15:07:20.734146+0000","last_became_active":"2026-02-25T15:01:51.015292+0000","last_became_peered":"2026-02-25T15:01:51.015292+0000","last_unstale":"2026-02-25T15:07:20.734146+0000","last_undegraded":"2026-02-25T15:07:20.734146+0000","last_fullsized":"2026-02-25T15:07:20.734146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:06:39.316850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.353767+0000","last_change":"2026-02-25T15:01:51.625041+0000","last_active":"2026-02-25T15:07:21.353767+0000","last_peered":"2026-02-25T15:07:21.353767+0000","last_clean":"2026-02-25T15:07:21.353767+0000","last_became_active":"2026-02-25T15:01:51.622021+0000","last_became_peered":"2026-02-25T15:01:51.622021+0000","last_unstale":"2026-02-25T15:07:21.353767+0000","last_undegraded":"2026-02-25T15:07:21.353767+0000","last_fullsized":"2026-02-25T15:07:21.353767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:32:06.115017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.354792+0000","last_change":"2026-02-25T15:01:50.541523+0000","last_active":"2026-02-25T15:07:21.354792+0000","last_peered":"2026-02-25T15:07:21.354792+0000","last_clean":"2026-02-25T15:07:21.354792+0000","last_became_active":"2026-02-25T15:01:50.499499+0000","last_became_peered":"2026-02-25T15:01:50.499499+0000","last_unstale":"2026-02-25T15:07:21.354792+0000","last_undegraded":"2026-02-25T15:07:21.354792+0000","last_fullsized":"2026-02-25T15:07:21.354792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:45.307471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,12],"acting":[8,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.352813+0000","last_change":"2026-02-25T15:01:50.293543+0000","last_active":"2026-02-25T15:07:21.352813+0000","last_peered":"2026-02-25T15:07:21.352813+0000","last_clean":"2026-02-25T15:07:21.352813+0000","last_became_active":"2026-02-25T15:01:50.281495+0000","last_became_peered":"2026-02-25T15:01:50.281495+0000","last_unstale":"2026-02-25T15:07:21.352813+0000","last_undegraded":"2026-02-25T15:07:21.352813+0000","last_fullsized":"2026-02-25T15:07:21.352813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:43:35.579264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.1","version":"34'11","reported_seq":653,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763900+0000","last_change":"2026-02-25T15:01:50.681438+0000","last_active":"2026-02-25T15:07:22.763900+0000","last_peered":"2026-02-25T15:07:22.763900+0000","last_clean":"2026-02-25T15:07:22.763900+0000","last_became_active":"2026-02-25T15:01:50.639260+0000","last_became_peered":"2026-02-25T15:01:50.639260+0000","last_unstale":"2026-02-25T15:07:22.763900+0000","last_undegraded":"2026-02-25T15:07:22.763900+0000","last_fullsized":"2026-02-25T15:07:22.763900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:53:25.658215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761696+0000","last_change":"2026-02-25T15:01:50.710810+0000","last_active":"2026-02-25T15:07:22.761696+0000","last_peered":"2026-02-25T15:07:22.761696+0000","last_clean":"2026-02-25T15:07:22.761696+0000","last_became_active":"2026-02-25T15:01:50.708573+0000","last_became_peered":"2026-02-25T15:01:50.708573+0000","last_unstale":"2026-02-25T15:07:22.761696+0000","last_undegraded":"2026-02-25T15:07:22.761696+0000","last_fullsized":"2026-02-25T15:07:22.761696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:53:45.894951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":620,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.484173+0000","last_change":"2026-02-25T15:01:51.593638+0000","last_active":"2026-02-25T15:07:22.484173+0000","last_peered":"2026-02-25T15:07:22.484173+0000","last_clean":"2026-02-25T15:07:22.484173+0000","last_became_active":"2026-02-25T15:01:51.576151+0000","last_became_peered":"2026-02-25T15:01:51.576151+0000","last_unstale":"2026-02-25T15:07:22.484173+0000","last_undegraded":"2026-02-25T15:07:22.484173+0000","last_fullsized":"2026-02-25T15:07:22.484173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:22:41.062323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.346771+0000","last_change":"2026-02-25T15:01:50.715301+0000","last_active":"2026-02-25T15:07:21.346771+0000","last_peered":"2026-02-25T15:07:21.346771+0000","last_clean":"2026-02-25T15:07:21.346771+0000","last_became_active":"2026-02-25T15:01:50.713136+0000","last_became_peered":"2026-02-25T15:01:50.713136+0000","last_unstale":"2026-02-25T15:07:21.346771+0000","last_undegraded":"2026-02-25T15:07:21.346771+0000","last_fullsized":"2026-02-25T15:07:21.346771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:17:44.395283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":640,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.174002+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:07:22.174002+0000","last_peered":"2026-02-25T15:07:22.174002+0000","last_clean":"2026-02-25T15:07:22.174002+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:07:22.174002+0000","last_undegraded":"2026-02-25T15:07:22.174002+0000","last_fullsized":"2026-02-25T15:07:22.174002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":642,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766776+0000","last_change":"2026-02-25T15:01:17.810911+0000","last_active":"2026-02-25T15:07:22.766776+0000","last_peered":"2026-02-25T15:07:22.766776+0000","last_clean":"2026-02-25T15:07:22.766776+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:07:22.766776+0000","last_undegraded":"2026-02-25T15:07:22.766776+0000","last_fullsized":"2026-02-25T15:07:22.766776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:24:11.882619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.482458+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:07:22.482458+0000","last_peered":"2026-02-25T15:07:22.482458+0000","last_clean":"2026-02-25T15:07:22.482458+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:07:22.482458+0000","last_undegraded":"2026-02-25T15:07:22.482458+0000","last_fullsized":"2026-02-25T15:07:22.482458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:40:33.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.485965+0000","last_change":"2026-02-25T15:01:17.750860+0000","last_active":"2026-02-25T15:07:22.485965+0000","last_peered":"2026-02-25T15:07:22.485965+0000","last_clean":"2026-02-25T15:07:22.485965+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:07:22.485965+0000","last_undegraded":"2026-02-25T15:07:22.485965+0000","last_fullsized":"2026-02-25T15:07:22.485965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:42:01.069031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":642,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.170343+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:07:22.170343+0000","last_peered":"2026-02-25T15:07:22.170343+0000","last_clean":"2026-02-25T15:07:22.170343+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:07:22.170343+0000","last_undegraded":"2026-02-25T15:07:22.170343+0000","last_fullsized":"2026-02-25T15:07:22.170343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":638,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.744838+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:07:21.744838+0000","last_peered":"2026-02-25T15:07:21.744838+0000","last_clean":"2026-02-25T15:07:21.744838+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:07:21.744838+0000","last_undegraded":"2026-02-25T15:07:21.744838+0000","last_fullsized":"2026-02-25T15:07:21.744838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":639,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.348493+0000","last_change":"2026-02-25T15:01:17.333599+0000","last_active":"2026-02-25T15:07:21.348493+0000","last_peered":"2026-02-25T15:07:21.348493+0000","last_clean":"2026-02-25T15:07:21.348493+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:07:21.348493+0000","last_undegraded":"2026-02-25T15:07:21.348493+0000","last_fullsized":"2026-02-25T15:07:21.348493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:49:45.844553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":641,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.172758+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:07:22.172758+0000","last_peered":"2026-02-25T15:07:22.172758+0000","last_clean":"2026-02-25T15:07:22.172758+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:07:22.172758+0000","last_undegraded":"2026-02-25T15:07:22.172758+0000","last_fullsized":"2026-02-25T15:07:22.172758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":685,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.726590+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:07:20.726590+0000","last_peered":"2026-02-25T15:07:20.726590+0000","last_clean":"2026-02-25T15:07:20.726590+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:07:20.726590+0000","last_undegraded":"2026-02-25T15:07:20.726590+0000","last_fullsized":"2026-02-25T15:07:20.726590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":163,"kb_used_meta":26780,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167305,"internal_metadata":27423351},"hb_peers":[0,1,2,3,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34216,"kb_used_data":7256,"kb_used_omap":158,"kb_used_meta":26785,"kb_avail":94337624,"statfs":{"total":96636764160,"available":96601726976,"internally_reserved":0,"allocated":7430144,"data_stored":4731627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161981,"internal_metadata":27428675},"hb_peers":[0,1,2,4,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189804,"internal_metadata":27400852},"hb_peers":[0,1,3,4,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3088058,"internal_metadata":24502598},"hb_peers":[1,3,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280589,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2509,"kb_used_meta":24434,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2569932,"internal_metadata":25020724},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":2415,"kb_used_meta":24528,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2473663,"internal_metadata":25116993},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2463,"kb_used_meta":24480,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2522856,"internal_metadata":25067800},"hb_peers":[1,2,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214866,"internal_metadata":27375790},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34180,"kb_used_data":7220,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94337660,"statfs":{"total":96636764160,"available":96601763840,"internally_reserved":0,"allocated":7393280,"data_stored":4710204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208902,"internal_metadata":27381754},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":3013,"kb_used_meta":23930,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3085464,"internal_metadata":24505192},"hb_peers":[0,1,2,3,4,6,7,8,9,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":106,"kb_used_meta":26837,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108705,"internal_metadata":27481951},"hb_peers":[0,1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":6772,"kb_used_omap":3014,"kb_used_meta":41977,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3086891,"internal_metadata":42984917},"hb_peers":[1,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":2550,"kb_used_meta":24393,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2612076,"internal_metadata":24978580},"hb_peers":[0,1,2,3,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57481,"internal_metadata":27533175},"hb_peers":[1,3,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":4260236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084764,"internal_metadata":24505892},"hb_peers":[0,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138997,"internal_metadata":27451659},"hb_peers":[0,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:07:27.110 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T15:07:27.110 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.176+0000 7f3b270e8640 10 monclient: get_monmap_and_config 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.176+0000 7f3b270e8640 10 monclient: build_initial_monmap 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.176+0000 7f3b270e8640 10 monclient: monmap: 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:27.177321+0000 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:27.177321+0000 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:27.178 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 1 Processor -- start 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 1 -- start start 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient: init 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-b con 0x7f3b20058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-c con 0x7f3b200b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-a con 0x7f3b201626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b201655c0 con 0x7f3b201626a0 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b200b12b0 con 0x7f3b20058da0 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b200b1590 con 0x7f3b200b0410 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.177+0000 7f3b270e8640 10 monclient(hunting): authenticate will time out at 3390.769681s 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.178+0000 7f3b2565e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f3b201626a0 0x7f3b201c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50440/0 (socket says 10.20.193.21:50440) 2026-02-25T15:07:27.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.178+0000 7f3b2565e640 1 -- 10.20.193.21:0/2481842459 learned_addr learned my addr 10.20.193.21:0/2481842459 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913360484 0 0) 0x7f3b201655c0 con 0x7f3b201626a0 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): my global_id is 28152 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b0c003610 con 0x7f3b201626a0 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669759409 0 0) 0x7f3b200b1590 con 0x7f3b200b0410 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): my global_id is 30779 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b201655c0 con 0x7f3b200b0410 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138740271 0 0) 0x7f3b200b12b0 con 0x7f3b20058da0 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 10 monclient(hunting): my global_id is 29125 2026-02-25T15:07:27.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.179+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b200b1590 con 0x7f3b20058da0 2026-02-25T15:07:27.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1137981076 0 0) 0x7f3b0c003610 con 0x7f3b201626a0 2026-02-25T15:07:27.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 >> v1:10.20.193.68:6789/0 conn(0x7f3b200b0410 legacy=0x7f3b20164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 >> v1:10.20.193.31:6789/0 conn(0x7f3b20058da0 legacy=0x7f3b201647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 monclient: found mon.noname-a 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b200b1870 con 0x7f3b201626a0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b1c003170 con 0x7f3b201626a0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b177fe640 10 monclient: dump: 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b270e8640 5 monclient: authenticate success, global_id 28152 2026-02-25T15:07:27.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.181+0000 7f3b270e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b1c003340 con 0x7f3b201626a0 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 1 -- 10.20.193.21:0/2481842459 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b1c003780 con 0x7f3b201626a0 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b177fe640 10 monclient: dump: 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 4 set_mon_vals no callback set 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 10 monclient: shutdown 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 1 -- 10.20.193.21:0/2481842459 >> v1:10.20.193.21:6789/0 conn(0x7f3b201626a0 legacy=0x7f3b201c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 1 -- 10.20.193.21:0/2481842459 shutdown_connections 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 1 -- 10.20.193.21:0/2481842459 >> 10.20.193.21:0/2481842459 conn(0x7f3b200b65f0 msgr2=0x7f3b200b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 1 -- 10.20.193.21:0/2481842459 shutdown_connections 2026-02-25T15:07:27.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 1 -- 10.20.193.21:0/2481842459 wait complete. 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 10 monclient: build_initial_monmap 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.182+0000 7f3b270e8640 10 monclient: monmap: 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:27.185 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 librados: starting msgr at 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 librados: starting objecter 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 Processor -- start 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 -- start start 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 librados: setting wanted keys 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 librados: calling monclient init 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient: init 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-b con 0x7f3b20058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-c con 0x7f3b200b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient(hunting): picked mon.noname-a con 0x7f3b201626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2013a790 con 0x7f3b201626a0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2013aa70 con 0x7f3b20058da0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b201fb580 con 0x7f3b200b0410 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b270e8640 10 monclient(hunting): authenticate will time out at 3390.775599s 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b2565e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f3b201626a0 0x7f3b2005d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50444/0 (socket says 10.20.193.21:50444) 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.183+0000 7f3b2565e640 1 -- 10.20.193.21:0/626064576 learned_addr learned my addr 10.20.193.21:0/626064576 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter ms_handle_connect 0x7f3b201626a0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter ms_handle_connect 0x7f3b20058da0 2026-02-25T15:07:27.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter ms_handle_connect 0x7f3b200b0410 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.184+0000 7f3b157fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241636573 0 0) 0x7f3b2013a790 con 0x7f3b201626a0 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): my global_id is 28155 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af0003610 con 0x7f3b201626a0 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296180596 0 0) 0x7f3b2013aa70 con 0x7f3b20058da0 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): my global_id is 29128 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2013a790 con 0x7f3b20058da0 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209129831 0 0) 0x7f3b201fb580 con 0x7f3b200b0410 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 10 monclient(hunting): my global_id is 30782 2026-02-25T15:07:27.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.185+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2013aa70 con 0x7f3b200b0410 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1688541866 0 0) 0x7f3b2013a790 con 0x7f3b20058da0 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b201fb580 con 0x7f3b20058da0 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1034952448 0 0) 0x7f3b2013aa70 con 0x7f3b200b0410 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b2013a790 con 0x7f3b200b0410 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b10003060 con 0x7f3b20058da0 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): dump: 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.189 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b08002ff0 con 0x7f3b200b0410 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): dump: 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 640767627 0 0) 0x7f3af0003610 con 0x7f3b201626a0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b2013aa70 con 0x7f3b201626a0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b1c003690 con 0x7f3b201626a0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.187+0000 7f3b157fa640 10 monclient(hunting): dump: 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.190 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4021906746 0 0) 0x7f3b201fb580 con 0x7f3b20058da0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 >> v1:10.20.193.68:6789/0 conn(0x7f3b200b0410 legacy=0x7f3b20139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 >> v1:10.20.193.21:6789/0 conn(0x7f3b201626a0 legacy=0x7f3b2005d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 1 monclient: found mon.b 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b201fb860 con 0x7f3b20058da0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 5 monclient: authenticate success, global_id 29128 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _renew_subs 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2013ad50 con 0x7f3b20058da0 2026-02-25T15:07:27.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 client.29128.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _renew_subs 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b201fc240 con 0x7f3b20058da0 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 1 librados: init done 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.189+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b200b0c40 con 0x7f3b20058da0 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b10003200 con 0x7f3b20058da0 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3b10003920 con 0x7f3b20058da0 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b16ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.196+0000 7f3b157fa640 10 monclient: dump: 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.198 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.197+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3b1001ce00 con 0x7f3b20058da0 2026-02-25T15:07:27.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.198+0000 7f3b17fff640 10 monclient: get_auth_request con 0x7f3af007a060 auth_method 0 2026-02-25T15:07:27.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.198+0000 7f3b157fa640 10 client.29128.objecter ms_handle_connect 0x7f3af007a060 2026-02-25T15:07:27.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.199+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f3b100948b0 con 0x7f3b20058da0 2026-02-25T15:07:27.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.199+0000 7f3b157fa640 10 client.29128.objecter ms_dispatch2 0x7f3b20000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:27.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.199+0000 7f3b157fa640 3 client.29128.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:27.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.199+0000 7f3b157fa640 3 client.29128.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:27.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.199+0000 7f3b157fa640 20 client.29128.objecter dump_active .. 0 homeless 2026-02-25T15:07:27.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.283+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f3b200b0c40 con 0x7f3b20058da0 2026-02-25T15:07:27.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.283+0000 7f3b157fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.285 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.283+0000 7f3b157fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:27.388 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.386+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b20162150 con 0x7f3af007a060 2026-02-25T15:07:27.390 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.388+0000 7f3b157fa640 1 -- 10.20.193.21:0/626064576 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125409 (unknown 2965378022 0 3746370452) 0x7f3b20162150 con 0x7f3af007a060 2026-02-25T15:07:27.391 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:27.392 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:07:27.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 10 librados: watch_flush enter 2026-02-25T15:07:27.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 10 librados: watch_flush exit 2026-02-25T15:07:27.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 20 client.29128.objecter shutdown clearing up homeless session... 2026-02-25T15:07:27.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 10 client.29128.objecter successfully canceled tick 2026-02-25T15:07:27.394 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3af007a060 legacy=0x7f3af009a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 10 monclient: shutdown 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 >> v1:10.20.193.31:6789/0 conn(0x7f3b20058da0 legacy=0x7f3b201fe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 shutdown_connections 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 >> 10.20.193.21:0/626064576 conn(0x7f3b200b65f0 msgr2=0x7f3b20055cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 shutdown_connections 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 -- 10.20.193.21:0/626064576 wait complete. 2026-02-25T15:07:27.395 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.390+0000 7f3b270e8640 1 librados: shutdown 2026-02-25T15:07:27.400 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2026-02-25T15:07:25.944876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":94,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":558688,"kb_used_data":109280,"kb_used_omap":23214,"kb_used_meta":425937,"kb_avail":1509390752,"statfs":{"total":1546188226560,"available":1545616130048,"internally_reserved":0,"allocated":111902720,"data_stored":68980999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23771745,"internal_metadata":436159903},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":61,"apply_latency_ms":61,"commit_latency_ns":61000000,"apply_latency_ns":61000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.147859"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":622,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.729088+0000","last_change":"2026-02-25T15:01:50.952960+0000","last_active":"2026-02-25T15:07:20.729088+0000","last_peered":"2026-02-25T15:07:20.729088+0000","last_clean":"2026-02-25T15:07:20.729088+0000","last_became_active":"2026-02-25T15:01:50.928434+0000","last_became_peered":"2026-02-25T15:01:50.928434+0000","last_unstale":"2026-02-25T15:07:20.729088+0000","last_undegraded":"2026-02-25T15:07:20.729088+0000","last_fullsized":"2026-02-25T15:07:20.729088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:04:36.449802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763811+0000","last_change":"2026-02-25T15:01:51.873447+0000","last_active":"2026-02-25T15:07:22.763811+0000","last_peered":"2026-02-25T15:07:22.763811+0000","last_clean":"2026-02-25T15:07:22.763811+0000","last_became_active":"2026-02-25T15:01:51.860656+0000","last_became_peered":"2026-02-25T15:01:51.860656+0000","last_unstale":"2026-02-25T15:07:22.763811+0000","last_undegraded":"2026-02-25T15:07:22.763811+0000","last_fullsized":"2026-02-25T15:07:22.763811+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.276300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.760320+0000","last_change":"2026-02-25T15:01:50.973519+0000","last_active":"2026-02-25T15:07:22.760320+0000","last_peered":"2026-02-25T15:07:22.760320+0000","last_clean":"2026-02-25T15:07:22.760320+0000","last_became_active":"2026-02-25T15:01:50.970996+0000","last_became_peered":"2026-02-25T15:01:50.970996+0000","last_unstale":"2026-02-25T15:07:22.760320+0000","last_undegraded":"2026-02-25T15:07:22.760320+0000","last_fullsized":"2026-02-25T15:07:22.760320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:26:45.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766921+0000","last_change":"2026-02-25T15:01:51.088801+0000","last_active":"2026-02-25T15:07:22.766921+0000","last_peered":"2026-02-25T15:07:22.766921+0000","last_clean":"2026-02-25T15:07:22.766921+0000","last_became_active":"2026-02-25T15:01:50.996313+0000","last_became_peered":"2026-02-25T15:01:50.996313+0000","last_unstale":"2026-02-25T15:07:22.766921+0000","last_undegraded":"2026-02-25T15:07:22.766921+0000","last_fullsized":"2026-02-25T15:07:22.766921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:06:48.841244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,14],"acting":[3,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345212+0000","last_change":"2026-02-25T15:01:50.401182+0000","last_active":"2026-02-25T15:07:21.345212+0000","last_peered":"2026-02-25T15:07:21.345212+0000","last_clean":"2026-02-25T15:07:21.345212+0000","last_became_active":"2026-02-25T15:01:50.387274+0000","last_became_peered":"2026-02-25T15:01:50.387274+0000","last_unstale":"2026-02-25T15:07:21.345212+0000","last_undegraded":"2026-02-25T15:07:21.345212+0000","last_fullsized":"2026-02-25T15:07:21.345212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:55.705403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.344060+0000","last_change":"2026-02-25T15:01:50.841299+0000","last_active":"2026-02-25T15:07:21.344060+0000","last_peered":"2026-02-25T15:07:21.344060+0000","last_clean":"2026-02-25T15:07:21.344060+0000","last_became_active":"2026-02-25T15:01:50.835823+0000","last_became_peered":"2026-02-25T15:01:50.835823+0000","last_unstale":"2026-02-25T15:07:21.344060+0000","last_undegraded":"2026-02-25T15:07:21.344060+0000","last_fullsized":"2026-02-25T15:07:21.344060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:31:50.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.768685+0000","last_change":"2026-02-25T15:01:50.540680+0000","last_active":"2026-02-25T15:07:22.768685+0000","last_peered":"2026-02-25T15:07:22.768685+0000","last_clean":"2026-02-25T15:07:22.768685+0000","last_became_active":"2026-02-25T15:01:50.532546+0000","last_became_peered":"2026-02-25T15:01:50.532546+0000","last_unstale":"2026-02-25T15:07:22.768685+0000","last_undegraded":"2026-02-25T15:07:22.768685+0000","last_fullsized":"2026-02-25T15:07:22.768685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:18:05.725236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.500939+0000","last_change":"2026-02-25T15:01:50.693608+0000","last_active":"2026-02-25T15:07:22.500939+0000","last_peered":"2026-02-25T15:07:22.500939+0000","last_clean":"2026-02-25T15:07:22.500939+0000","last_became_active":"2026-02-25T15:01:50.688197+0000","last_became_peered":"2026-02-25T15:01:50.688197+0000","last_unstale":"2026-02-25T15:07:22.500939+0000","last_undegraded":"2026-02-25T15:07:22.500939+0000","last_fullsized":"2026-02-25T15:07:22.500939+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:32:30.363960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.733234+0000","last_change":"2026-02-25T15:01:50.782822+0000","last_active":"2026-02-25T15:07:20.733234+0000","last_peered":"2026-02-25T15:07:20.733234+0000","last_clean":"2026-02-25T15:07:20.733234+0000","last_became_active":"2026-02-25T15:01:50.780343+0000","last_became_peered":"2026-02-25T15:01:50.780343+0000","last_unstale":"2026-02-25T15:07:20.733234+0000","last_undegraded":"2026-02-25T15:07:20.733234+0000","last_fullsized":"2026-02-25T15:07:20.733234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:56:59.786199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.345435+0000","last_change":"2026-02-25T15:01:50.885131+0000","last_active":"2026-02-25T15:07:21.345435+0000","last_peered":"2026-02-25T15:07:21.345435+0000","last_clean":"2026-02-25T15:07:21.345435+0000","last_became_active":"2026-02-25T15:01:50.870593+0000","last_became_peered":"2026-02-25T15:01:50.870593+0000","last_unstale":"2026-02-25T15:07:21.345435+0000","last_undegraded":"2026-02-25T15:07:21.345435+0000","last_fullsized":"2026-02-25T15:07:21.345435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:11:54.381039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761032+0000","last_change":"2026-02-25T15:01:51.947696+0000","last_active":"2026-02-25T15:07:22.761032+0000","last_peered":"2026-02-25T15:07:22.761032+0000","last_clean":"2026-02-25T15:07:22.761032+0000","last_became_active":"2026-02-25T15:01:51.925016+0000","last_became_peered":"2026-02-25T15:01:51.925016+0000","last_unstale":"2026-02-25T15:07:22.761032+0000","last_undegraded":"2026-02-25T15:07:22.761032+0000","last_fullsized":"2026-02-25T15:07:22.761032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:22:43.384939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766787+0000","last_change":"2026-02-25T15:01:51.557264+0000","last_active":"2026-02-25T15:07:22.766787+0000","last_peered":"2026-02-25T15:07:22.766787+0000","last_clean":"2026-02-25T15:07:22.766787+0000","last_became_active":"2026-02-25T15:01:51.540535+0000","last_became_peered":"2026-02-25T15:01:51.540535+0000","last_unstale":"2026-02-25T15:07:22.766787+0000","last_undegraded":"2026-02-25T15:07:22.766787+0000","last_fullsized":"2026-02-25T15:07:22.766787+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:23:10.989525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":625,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.173211+0000","last_change":"2026-02-25T15:01:50.882445+0000","last_active":"2026-02-25T15:07:22.173211+0000","last_peered":"2026-02-25T15:07:22.173211+0000","last_clean":"2026-02-25T15:07:22.173211+0000","last_became_active":"2026-02-25T15:01:50.877038+0000","last_became_peered":"2026-02-25T15:01:50.877038+0000","last_unstale":"2026-02-25T15:07:22.173211+0000","last_undegraded":"2026-02-25T15:07:22.173211+0000","last_fullsized":"2026-02-25T15:07:22.173211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:40.152080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.762581+0000","last_change":"2026-02-25T15:01:51.252298+0000","last_active":"2026-02-25T15:07:22.762581+0000","last_peered":"2026-02-25T15:07:22.762581+0000","last_clean":"2026-02-25T15:07:22.762581+0000","last_became_active":"2026-02-25T15:01:51.250085+0000","last_became_peered":"2026-02-25T15:01:51.250085+0000","last_unstale":"2026-02-25T15:07:22.762581+0000","last_undegraded":"2026-02-25T15:07:22.762581+0000","last_fullsized":"2026-02-25T15:07:22.762581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:04:10.324827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.495124+0000","last_change":"2026-02-25T15:01:50.457459+0000","last_active":"2026-02-25T15:07:21.495124+0000","last_peered":"2026-02-25T15:07:21.495124+0000","last_clean":"2026-02-25T15:07:21.495124+0000","last_became_active":"2026-02-25T15:01:50.455002+0000","last_became_peered":"2026-02-25T15:01:50.455002+0000","last_unstale":"2026-02-25T15:07:21.495124+0000","last_undegraded":"2026-02-25T15:07:21.495124+0000","last_fullsized":"2026-02-25T15:07:21.495124+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:12:16.467863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.499564+0000","last_change":"2026-02-25T15:01:50.764280+0000","last_active":"2026-02-25T15:07:22.499564+0000","last_peered":"2026-02-25T15:07:22.499564+0000","last_clean":"2026-02-25T15:07:22.499564+0000","last_became_active":"2026-02-25T15:01:50.762167+0000","last_became_peered":"2026-02-25T15:01:50.762167+0000","last_unstale":"2026-02-25T15:07:22.499564+0000","last_undegraded":"2026-02-25T15:07:22.499564+0000","last_fullsized":"2026-02-25T15:07:22.499564+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:04:31.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3],"acting":[13,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":624,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.756720+0000","last_change":"2026-02-25T15:01:50.542740+0000","last_active":"2026-02-25T15:07:22.756720+0000","last_peered":"2026-02-25T15:07:22.756720+0000","last_clean":"2026-02-25T15:07:22.756720+0000","last_became_active":"2026-02-25T15:01:50.536997+0000","last_became_peered":"2026-02-25T15:01:50.536997+0000","last_unstale":"2026-02-25T15:07:22.756720+0000","last_undegraded":"2026-02-25T15:07:22.756720+0000","last_fullsized":"2026-02-25T15:07:22.756720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:40:49.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.351419+0000","last_change":"2026-02-25T15:01:50.446794+0000","last_active":"2026-02-25T15:07:21.351419+0000","last_peered":"2026-02-25T15:07:21.351419+0000","last_clean":"2026-02-25T15:07:21.351419+0000","last_became_active":"2026-02-25T15:01:50.444694+0000","last_became_peered":"2026-02-25T15:01:50.444694+0000","last_unstale":"2026-02-25T15:07:21.351419+0000","last_undegraded":"2026-02-25T15:07:21.351419+0000","last_fullsized":"2026-02-25T15:07:21.351419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:11:26.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.747184+0000","last_change":"2026-02-25T15:01:51.582040+0000","last_active":"2026-02-25T15:07:21.747184+0000","last_peered":"2026-02-25T15:07:21.747184+0000","last_clean":"2026-02-25T15:07:21.747184+0000","last_became_active":"2026-02-25T15:01:51.576775+0000","last_became_peered":"2026-02-25T15:01:51.576775+0000","last_unstale":"2026-02-25T15:07:21.747184+0000","last_undegraded":"2026-02-25T15:07:21.747184+0000","last_fullsized":"2026-02-25T15:07:21.747184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:10:05.577790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.735858+0000","last_change":"2026-02-25T15:01:51.716484+0000","last_active":"2026-02-25T15:07:20.735858+0000","last_peered":"2026-02-25T15:07:20.735858+0000","last_clean":"2026-02-25T15:07:20.735858+0000","last_became_active":"2026-02-25T15:01:51.713882+0000","last_became_peered":"2026-02-25T15:01:51.713882+0000","last_unstale":"2026-02-25T15:07:20.735858+0000","last_undegraded":"2026-02-25T15:07:20.735858+0000","last_fullsized":"2026-02-25T15:07:20.735858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:05.150346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,14],"acting":[7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343261+0000","last_change":"2026-02-25T15:01:50.434699+0000","last_active":"2026-02-25T15:07:21.343261+0000","last_peered":"2026-02-25T15:07:21.343261+0000","last_clean":"2026-02-25T15:07:21.343261+0000","last_became_active":"2026-02-25T15:01:50.432641+0000","last_became_peered":"2026-02-25T15:01:50.432641+0000","last_unstale":"2026-02-25T15:07:21.343261+0000","last_undegraded":"2026-02-25T15:07:21.343261+0000","last_fullsized":"2026-02-25T15:07:21.343261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:59:56.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.343573+0000","last_change":"2026-02-25T15:01:50.372550+0000","last_active":"2026-02-25T15:07:21.343573+0000","last_peered":"2026-02-25T15:07:21.343573+0000","last_clean":"2026-02-25T15:07:21.343573+0000","last_became_active":"2026-02-25T15:01:50.366512+0000","last_became_peered":"2026-02-25T15:01:50.366512+0000","last_unstale":"2026-02-25T15:07:21.343573+0000","last_undegraded":"2026-02-25T15:07:21.343573+0000","last_fullsized":"2026-02-25T15:07:21.343573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:11:04.786493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":625,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.764190+0000","last_change":"2026-02-25T15:01:50.801667+0000","last_active":"2026-02-25T15:07:22.764190+0000","last_peered":"2026-02-25T15:07:22.764190+0000","last_clean":"2026-02-25T15:07:22.764190+0000","last_became_active":"2026-02-25T15:01:50.798788+0000","last_became_peered":"2026-02-25T15:01:50.798788+0000","last_unstale":"2026-02-25T15:07:22.764190+0000","last_undegraded":"2026-02-25T15:07:22.764190+0000","last_fullsized":"2026-02-25T15:07:22.764190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:05:57.793192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":627,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.765661+0000","last_change":"2026-02-25T15:01:51.520848+0000","last_active":"2026-02-25T15:07:22.765661+0000","last_peered":"2026-02-25T15:07:22.765661+0000","last_clean":"2026-02-25T15:07:22.765661+0000","last_became_active":"2026-02-25T15:01:51.516175+0000","last_became_peered":"2026-02-25T15:01:51.516175+0000","last_unstale":"2026-02-25T15:07:22.765661+0000","last_undegraded":"2026-02-25T15:07:22.765661+0000","last_fullsized":"2026-02-25T15:07:22.765661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:36:33.921739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,6],"acting":[12,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":620,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.734146+0000","last_change":"2026-02-25T15:01:51.024149+0000","last_active":"2026-02-25T15:07:20.734146+0000","last_peered":"2026-02-25T15:07:20.734146+0000","last_clean":"2026-02-25T15:07:20.734146+0000","last_became_active":"2026-02-25T15:01:51.015292+0000","last_became_peered":"2026-02-25T15:01:51.015292+0000","last_unstale":"2026-02-25T15:07:20.734146+0000","last_undegraded":"2026-02-25T15:07:20.734146+0000","last_fullsized":"2026-02-25T15:07:20.734146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:06:39.316850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":619,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.353767+0000","last_change":"2026-02-25T15:01:51.625041+0000","last_active":"2026-02-25T15:07:21.353767+0000","last_peered":"2026-02-25T15:07:21.353767+0000","last_clean":"2026-02-25T15:07:21.353767+0000","last_became_active":"2026-02-25T15:01:51.622021+0000","last_became_peered":"2026-02-25T15:01:51.622021+0000","last_unstale":"2026-02-25T15:07:21.353767+0000","last_undegraded":"2026-02-25T15:07:21.353767+0000","last_fullsized":"2026-02-25T15:07:21.353767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:32:06.115017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.354792+0000","last_change":"2026-02-25T15:01:50.541523+0000","last_active":"2026-02-25T15:07:21.354792+0000","last_peered":"2026-02-25T15:07:21.354792+0000","last_clean":"2026-02-25T15:07:21.354792+0000","last_became_active":"2026-02-25T15:01:50.499499+0000","last_became_peered":"2026-02-25T15:01:50.499499+0000","last_unstale":"2026-02-25T15:07:21.354792+0000","last_undegraded":"2026-02-25T15:07:21.354792+0000","last_fullsized":"2026-02-25T15:07:21.354792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:45.307471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,12],"acting":[8,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":623,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.352813+0000","last_change":"2026-02-25T15:01:50.293543+0000","last_active":"2026-02-25T15:07:21.352813+0000","last_peered":"2026-02-25T15:07:21.352813+0000","last_clean":"2026-02-25T15:07:21.352813+0000","last_became_active":"2026-02-25T15:01:50.281495+0000","last_became_peered":"2026-02-25T15:01:50.281495+0000","last_unstale":"2026-02-25T15:07:21.352813+0000","last_undegraded":"2026-02-25T15:07:21.352813+0000","last_fullsized":"2026-02-25T15:07:21.352813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:43:35.579264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.1","version":"34'11","reported_seq":653,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.763900+0000","last_change":"2026-02-25T15:01:50.681438+0000","last_active":"2026-02-25T15:07:22.763900+0000","last_peered":"2026-02-25T15:07:22.763900+0000","last_clean":"2026-02-25T15:07:22.763900+0000","last_became_active":"2026-02-25T15:01:50.639260+0000","last_became_peered":"2026-02-25T15:01:50.639260+0000","last_unstale":"2026-02-25T15:07:22.763900+0000","last_undegraded":"2026-02-25T15:07:22.763900+0000","last_fullsized":"2026-02-25T15:07:22.763900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:53:25.658215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":623,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.761696+0000","last_change":"2026-02-25T15:01:50.710810+0000","last_active":"2026-02-25T15:07:22.761696+0000","last_peered":"2026-02-25T15:07:22.761696+0000","last_clean":"2026-02-25T15:07:22.761696+0000","last_became_active":"2026-02-25T15:01:50.708573+0000","last_became_peered":"2026-02-25T15:01:50.708573+0000","last_unstale":"2026-02-25T15:07:22.761696+0000","last_undegraded":"2026-02-25T15:07:22.761696+0000","last_fullsized":"2026-02-25T15:07:22.761696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:53:45.894951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":620,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.484173+0000","last_change":"2026-02-25T15:01:51.593638+0000","last_active":"2026-02-25T15:07:22.484173+0000","last_peered":"2026-02-25T15:07:22.484173+0000","last_clean":"2026-02-25T15:07:22.484173+0000","last_became_active":"2026-02-25T15:01:51.576151+0000","last_became_peered":"2026-02-25T15:01:51.576151+0000","last_unstale":"2026-02-25T15:07:22.484173+0000","last_undegraded":"2026-02-25T15:07:22.484173+0000","last_fullsized":"2026-02-25T15:07:22.484173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:22:41.062323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":617,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.346771+0000","last_change":"2026-02-25T15:01:50.715301+0000","last_active":"2026-02-25T15:07:21.346771+0000","last_peered":"2026-02-25T15:07:21.346771+0000","last_clean":"2026-02-25T15:07:21.346771+0000","last_became_active":"2026-02-25T15:01:50.713136+0000","last_became_peered":"2026-02-25T15:01:50.713136+0000","last_unstale":"2026-02-25T15:07:21.346771+0000","last_undegraded":"2026-02-25T15:07:21.346771+0000","last_fullsized":"2026-02-25T15:07:21.346771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:17:44.395283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":640,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.174002+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:07:22.174002+0000","last_peered":"2026-02-25T15:07:22.174002+0000","last_clean":"2026-02-25T15:07:22.174002+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:07:22.174002+0000","last_undegraded":"2026-02-25T15:07:22.174002+0000","last_fullsized":"2026-02-25T15:07:22.174002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":642,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.766776+0000","last_change":"2026-02-25T15:01:17.810911+0000","last_active":"2026-02-25T15:07:22.766776+0000","last_peered":"2026-02-25T15:07:22.766776+0000","last_clean":"2026-02-25T15:07:22.766776+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:07:22.766776+0000","last_undegraded":"2026-02-25T15:07:22.766776+0000","last_fullsized":"2026-02-25T15:07:22.766776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:24:11.882619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.482458+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:07:22.482458+0000","last_peered":"2026-02-25T15:07:22.482458+0000","last_clean":"2026-02-25T15:07:22.482458+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:07:22.482458+0000","last_undegraded":"2026-02-25T15:07:22.482458+0000","last_fullsized":"2026-02-25T15:07:22.482458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:40:33.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":635,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.485965+0000","last_change":"2026-02-25T15:01:17.750860+0000","last_active":"2026-02-25T15:07:22.485965+0000","last_peered":"2026-02-25T15:07:22.485965+0000","last_clean":"2026-02-25T15:07:22.485965+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:07:22.485965+0000","last_undegraded":"2026-02-25T15:07:22.485965+0000","last_fullsized":"2026-02-25T15:07:22.485965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:42:01.069031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":642,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.170343+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:07:22.170343+0000","last_peered":"2026-02-25T15:07:22.170343+0000","last_clean":"2026-02-25T15:07:22.170343+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:07:22.170343+0000","last_undegraded":"2026-02-25T15:07:22.170343+0000","last_fullsized":"2026-02-25T15:07:22.170343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":638,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.744838+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:07:21.744838+0000","last_peered":"2026-02-25T15:07:21.744838+0000","last_clean":"2026-02-25T15:07:21.744838+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:07:21.744838+0000","last_undegraded":"2026-02-25T15:07:21.744838+0000","last_fullsized":"2026-02-25T15:07:21.744838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":639,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:21.348493+0000","last_change":"2026-02-25T15:01:17.333599+0000","last_active":"2026-02-25T15:07:21.348493+0000","last_peered":"2026-02-25T15:07:21.348493+0000","last_clean":"2026-02-25T15:07:21.348493+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:07:21.348493+0000","last_undegraded":"2026-02-25T15:07:21.348493+0000","last_fullsized":"2026-02-25T15:07:21.348493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:49:45.844553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":641,"reported_epoch":338,"state":"active+clean","last_fresh":"2026-02-25T15:07:22.172758+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:07:22.172758+0000","last_peered":"2026-02-25T15:07:22.172758+0000","last_clean":"2026-02-25T15:07:22.172758+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:07:22.172758+0000","last_undegraded":"2026-02-25T15:07:22.172758+0000","last_fullsized":"2026-02-25T15:07:22.172758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":685,"reported_epoch":337,"state":"active+clean","last_fresh":"2026-02-25T15:07:20.726590+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:07:20.726590+0000","last_peered":"2026-02-25T15:07:20.726590+0000","last_clean":"2026-02-25T15:07:20.726590+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:07:20.726590+0000","last_undegraded":"2026-02-25T15:07:20.726590+0000","last_fullsized":"2026-02-25T15:07:20.726590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":163,"kb_used_meta":26780,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167305,"internal_metadata":27423351},"hb_peers":[0,1,2,3,4,5,6,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280590,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34216,"kb_used_data":7256,"kb_used_omap":158,"kb_used_meta":26785,"kb_avail":94337624,"statfs":{"total":96636764160,"available":96601726976,"internally_reserved":0,"allocated":7430144,"data_stored":4731627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161981,"internal_metadata":27428675},"hb_peers":[0,1,2,4,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189804,"internal_metadata":27400852},"hb_peers":[0,1,3,4,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3088058,"internal_metadata":24502598},"hb_peers":[1,3,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280589,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2509,"kb_used_meta":24434,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2569932,"internal_metadata":25020724},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33708,"kb_used_data":6748,"kb_used_omap":2415,"kb_used_meta":24528,"kb_avail":94338132,"statfs":{"total":96636764160,"available":96602247168,"internally_reserved":0,"allocated":6909952,"data_stored":4240751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2473663,"internal_metadata":25116993},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":2463,"kb_used_meta":24480,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2522856,"internal_metadata":25067800},"hb_peers":[1,2,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214866,"internal_metadata":27375790},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313293,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34180,"kb_used_data":7220,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94337660,"statfs":{"total":96636764160,"available":96601763840,"internally_reserved":0,"allocated":7393280,"data_stored":4710204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208902,"internal_metadata":27381754},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":3013,"kb_used_meta":23930,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3085464,"internal_metadata":24505192},"hb_peers":[0,1,2,3,4,6,7,8,9,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33728,"kb_used_data":6768,"kb_used_omap":106,"kb_used_meta":26837,"kb_avail":94338112,"statfs":{"total":96636764160,"available":96602226688,"internally_reserved":0,"allocated":6930432,"data_stored":4250924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108705,"internal_metadata":27481951},"hb_peers":[0,1,2,3,4,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280590,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":6772,"kb_used_omap":3014,"kb_used_meta":41977,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3086891,"internal_metadata":42984917},"hb_peers":[1,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":2550,"kb_used_meta":24393,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2612076,"internal_metadata":24978580},"hb_peers":[0,1,2,3,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33744,"kb_used_data":6784,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":94338096,"statfs":{"total":96636764160,"available":96602210304,"internally_reserved":0,"allocated":6946816,"data_stored":4260231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57481,"internal_metadata":27533175},"hb_peers":[1,3,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280589,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33748,"kb_used_data":6788,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94338092,"statfs":{"total":96636764160,"available":96602206208,"internally_reserved":0,"allocated":6950912,"data_stored":4260236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3084764,"internal_metadata":24505892},"hb_peers":[0,3,4,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280590,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33732,"kb_used_data":6772,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94338108,"statfs":{"total":96636764160,"available":96602222592,"internally_reserved":0,"allocated":6934528,"data_stored":4250943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138997,"internal_metadata":27451659},"hb_peers":[0,3,4,5,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:07:27.404 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T15:07:27.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.470+0000 7f9ab685c640 10 monclient: get_monmap_and_config 2026-02-25T15:07:27.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.470+0000 7f9ab685c640 10 monclient: build_initial_monmap 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.470+0000 7f9ab685c640 10 monclient: monmap: 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:27.471522+0000 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:27.471522+0000 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:27.473 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:27.474 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:27.474 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 1 Processor -- start 2026-02-25T15:07:27.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 1 -- start start 2026-02-25T15:07:27.476 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient: init 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-b con 0x7f9ab01603a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-c con 0x7f9ab0056690 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-a con 0x7f9ab01613d0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.471+0000 7f9ab685c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab0161850 con 0x7f9ab01613d0 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab685c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab00592d0 con 0x7f9ab01603a0 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab685c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab00595b0 con 0x7f9ab0056690 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab685c640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab685c640 10 monclient(hunting): authenticate will time out at 3391.064017s 2026-02-25T15:07:27.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab4dd2640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9ab01613d0 0x7f9ab00b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50456/0 (socket says 10.20.193.21:50456) 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.472+0000 7f9ab4dd2640 1 -- 10.20.193.21:0/1495106344 learned_addr learned my addr 10.20.193.21:0/1495106344 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840059205 0 0) 0x7f9ab00595b0 con 0x7f9ab0056690 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): my global_id is 30785 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94003610 con 0x7f9ab0056690 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599694987 0 0) 0x7f9aa4002c90 con 0x7f9ab01613d0 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 10 monclient(hunting): my global_id is 28158 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.473+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab00595b0 con 0x7f9ab01613d0 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589185386 0 0) 0x7f9ab00592d0 con 0x7f9ab01603a0 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 10 monclient(hunting): my global_id is 29131 2026-02-25T15:07:27.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.474+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa4002c90 con 0x7f9ab01603a0 2026-02-25T15:07:27.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 448930597 0 0) 0x7f9a94003610 con 0x7f9ab0056690 2026-02-25T15:07:27.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 >> v1:10.20.193.31:6789/0 conn(0x7f9ab01603a0 legacy=0x7f9ab0160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 >> v1:10.20.193.21:6789/0 conn(0x7f9ab01613d0 legacy=0x7f9ab00b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:27.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 monclient: found mon.noname-c 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0059890 con 0x7f9ab0056690 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9aa0002df0 con 0x7f9ab0056690 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9aaeffd640 10 monclient: dump: 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.487 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9ab685c640 5 monclient: authenticate success, global_id 30785 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.475+0000 7f9ab685c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9aa0002fc0 con 0x7f9ab0056690 2026-02-25T15:07:27.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 1 -- 10.20.193.21:0/1495106344 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9aa0003400 con 0x7f9ab0056690 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9aaeffd640 10 monclient: dump: 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.489 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 4 set_mon_vals no callback set 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 10 monclient: shutdown 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 1 -- 10.20.193.21:0/1495106344 >> v1:10.20.193.68:6789/0 conn(0x7f9ab0056690 legacy=0x7f9ab0057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 1 -- 10.20.193.21:0/1495106344 shutdown_connections 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 1 -- 10.20.193.21:0/1495106344 >> 10.20.193.21:0/1495106344 conn(0x7f9ab00b65f0 msgr2=0x7f9ab00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 1 -- 10.20.193.21:0/1495106344 shutdown_connections 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 1 -- 10.20.193.21:0/1495106344 wait complete. 2026-02-25T15:07:27.490 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 10 monclient: build_initial_monmap 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.476+0000 7f9ab685c640 10 monclient: monmap: 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.491 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 librados: starting msgr at 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 librados: starting objecter 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 Processor -- start 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 -- start start 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 librados: setting wanted keys 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 librados: calling monclient init 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient: init 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-c con 0x7f9ab0056690 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-a con 0x7f9ab01603a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient(hunting): picked mon.noname-b con 0x7f9ab01613d0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:27.492 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab01fe8c0 con 0x7f9ab01603a0 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab005dba0 con 0x7f9ab01613d0 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab01feb60 con 0x7f9ab0056690 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9ab685c640 10 monclient(hunting): authenticate will time out at 3391.069686s 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9aaf7fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f9ab01603a0 0x7f9ab005d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50466/0 (socket says 10.20.193.21:50466) 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.477+0000 7f9aaf7fe640 1 -- 10.20.193.21:0/564246057 learned_addr learned my addr 10.20.193.21:0/564246057 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter ms_handle_connect 0x7f9ab01603a0 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter ms_handle_connect 0x7f9ab01613d0 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter ms_handle_connect 0x7f9ab0056690 2026-02-25T15:07:27.493 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.478+0000 7f9aacff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406326447 0 0) 0x7f9ab01fe8c0 con 0x7f9ab01603a0 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): my global_id is 28161 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a80003610 con 0x7f9ab01603a0 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712546732 0 0) 0x7f9ab005dba0 con 0x7f9ab01613d0 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): my global_id is 29134 2026-02-25T15:07:27.494 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab01fe8c0 con 0x7f9ab01613d0 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270109042 0 0) 0x7f9ab01feb60 con 0x7f9ab0056690 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 10 monclient(hunting): my global_id is 30788 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.479+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ab005dba0 con 0x7f9ab0056690 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3782026315 0 0) 0x7f9ab01fe8c0 con 0x7f9ab01613d0 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ab01feb60 con 0x7f9ab01613d0 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9aa40035d0 con 0x7f9ab01613d0 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:27.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): dump: 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1507980957 0 0) 0x7f9a80003610 con 0x7f9ab01603a0 2026-02-25T15:07:27.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ab01fe8c0 con 0x7f9ab01603a0 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9aa0003310 con 0x7f9ab01603a0 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.481+0000 7f9aacff9640 10 monclient(hunting): dump: 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.497 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2668062231 0 0) 0x7f9ab005dba0 con 0x7f9ab0056690 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a80003610 con 0x7f9ab0056690 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9a9c003060 con 0x7f9ab0056690 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.482+0000 7f9aacff9640 10 monclient(hunting): dump: 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.498 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3856707354 0 0) 0x7f9ab01feb60 con 0x7f9ab01613d0 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 >> v1:10.20.193.68:6789/0 conn(0x7f9ab0056690 legacy=0x7f9ab005b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 >> v1:10.20.193.21:6789/0 conn(0x7f9ab01603a0 legacy=0x7f9ab005d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 1 monclient: found mon.b 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:27.499 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab01fee40 con 0x7f9ab01613d0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9aacff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 5 monclient: authenticate success, global_id 29134 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _renew_subs 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab005de80 con 0x7f9ab01613d0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 client.29134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _renew_subs 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ab013a180 con 0x7f9ab01613d0 2026-02-25T15:07:27.500 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 1 librados: init done 2026-02-25T15:07:27.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.501 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.483+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0163240 con 0x7f9ab01613d0 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9aa4004f00 con 0x7f9ab01613d0 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f9aa40050b0 con 0x7f9ab01613d0 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 10 monclient: dump: 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:27.576 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:27.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aae7fc640 4 set_mon_vals no callback set 2026-02-25T15:07:27.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.574+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f9aa401e590 con 0x7f9ab01613d0 2026-02-25T15:07:27.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.575+0000 7f9aaffff640 10 monclient: get_auth_request con 0x7f9a8007a110 auth_method 0 2026-02-25T15:07:27.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.575+0000 7f9aacff9640 10 client.29134.objecter ms_handle_connect 0x7f9a8007a110 2026-02-25T15:07:27.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.576+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f9aa405b110 con 0x7f9ab01613d0 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.576+0000 7f9aacff9640 10 client.29134.objecter ms_dispatch2 0x7f9ab0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.576+0000 7f9aacff9640 3 client.29134.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.576+0000 7f9aacff9640 3 client.29134.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.576+0000 7f9aacff9640 20 client.29134.objecter dump_active .. 0 homeless 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.577+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f9ab0161850 con 0x7f9ab01613d0 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.577+0000 7f9aacff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:27.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.577+0000 7f9aacff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:27.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.681+0000 7f9ab685c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:07:27.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.681+0000 7f9ab685c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:07:27.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.681+0000 7f9ab685c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:27.683 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.681+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ab00a8280 con 0x7f9ab01613d0 2026-02-25T15:07:27.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9aacff9640 1 -- 10.20.193.21:0/564246057 <== mon.1 v1:10.20.193.31:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v342) ==== 74+0+23362 (unknown 3944092366 0 1715186597) 0x7f9aa405f880 con 0x7f9ab01613d0 2026-02-25T15:07:27.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9aacff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-25T15:07:27.698 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9aacff9640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:07:27.698 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:27.699 INFO:teuthology.orchestra.run.trial021.stdout:{"epoch":342,"fsid":"78eb62b3-faf7-40dd-bfaf-5abbadd7c17c","created":"2026-02-25T15:00:32.654030+0000","modified":"2026-02-25T15:07:25.872809+0000","last_up_change":"2026-02-25T15:01:06.008609+0000","last_in_change":"2026-02-25T15:00:39.668731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":94,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-25T15:01:05.912164+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-25T15:01:13.971952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":34,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-25T15:01:47.861000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dace5762-92f4-44c8-bdc3-79eeb83edabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6804","nonce":2253484549}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6805","nonce":2253484549}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6807","nonce":2253484549}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6806","nonce":2253484549}]},"public_addr":"10.20.193.21:6804/2253484549","cluster_addr":"10.20.193.21:6805/2253484549","heartbeat_back_addr":"10.20.193.21:6807/2253484549","heartbeat_front_addr":"10.20.193.21:6806/2253484549","state":["exists","up"]},{"osd":1,"uuid":"5c83bd4f-2319-4fd7-82f0-610e641cdc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6808","nonce":1809978267}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6809","nonce":1809978267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6811","nonce":1809978267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6810","nonce":1809978267}]},"public_addr":"10.20.193.31:6808/1809978267","cluster_addr":"10.20.193.31:6809/1809978267","heartbeat_back_addr":"10.20.193.31:6811/1809978267","heartbeat_front_addr":"10.20.193.31:6810/1809978267","state":["exists","up"]},{"osd":2,"uuid":"e759c1bc-5b57-44ef-8aac-43af8ba53901","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":3838375510}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":3838375510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":3838375510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":3838375510}]},"public_addr":"10.20.193.68:6812/3838375510","cluster_addr":"10.20.193.68:6813/3838375510","heartbeat_back_addr":"10.20.193.68:6815/3838375510","heartbeat_front_addr":"10.20.193.68:6814/3838375510","state":["exists","up"]},{"osd":3,"uuid":"9f6295a8-a84b-431a-887b-fe1fcc8b4fa7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6805","nonce":464837367}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6806","nonce":464837367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6808","nonce":464837367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6807","nonce":464837367}]},"public_addr":"10.20.193.72:6805/464837367","cluster_addr":"10.20.193.72:6806/464837367","heartbeat_back_addr":"10.20.193.72:6808/464837367","heartbeat_front_addr":"10.20.193.72:6807/464837367","state":["exists","up"]},{"osd":4,"uuid":"8b44cddc-ab46-44b5-9e53-ff0aa8d1b538","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6812","nonce":2726560095}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6813","nonce":2726560095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6815","nonce":2726560095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6814","nonce":2726560095}]},"public_addr":"10.20.193.21:6812/2726560095","cluster_addr":"10.20.193.21:6813/2726560095","heartbeat_back_addr":"10.20.193.21:6815/2726560095","heartbeat_front_addr":"10.20.193.21:6814/2726560095","state":["exists","up"]},{"osd":5,"uuid":"c6adb78c-cb03-44a0-a9bd-aee84a864607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6812","nonce":2854385794}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6813","nonce":2854385794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6815","nonce":2854385794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6814","nonce":2854385794}]},"public_addr":"10.20.193.31:6812/2854385794","cluster_addr":"10.20.193.31:6813/2854385794","heartbeat_back_addr":"10.20.193.31:6815/2854385794","heartbeat_front_addr":"10.20.193.31:6814/2854385794","state":["exists","up"]},{"osd":6,"uuid":"2bb10359-a68d-4143-824c-54a8fb10f9a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":359632495}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":359632495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":359632495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":359632495}]},"public_addr":"10.20.193.68:6808/359632495","cluster_addr":"10.20.193.68:6809/359632495","heartbeat_back_addr":"10.20.193.68:6811/359632495","heartbeat_front_addr":"10.20.193.68:6810/359632495","state":["exists","up"]},{"osd":7,"uuid":"1f2b553f-d0bf-4ea0-ae80-cafc4db45470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6813","nonce":85233281}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6814","nonce":85233281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6816","nonce":85233281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6815","nonce":85233281}]},"public_addr":"10.20.193.72:6813/85233281","cluster_addr":"10.20.193.72:6814/85233281","heartbeat_back_addr":"10.20.193.72:6816/85233281","heartbeat_front_addr":"10.20.193.72:6815/85233281","state":["exists","up"]},{"osd":8,"uuid":"cc24764d-37ea-492f-9a2b-cc82dc42d5f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":295,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6800","nonce":3085828309}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6801","nonce":3085828309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6803","nonce":3085828309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6802","nonce":3085828309}]},"public_addr":"10.20.193.21:6800/3085828309","cluster_addr":"10.20.193.21:6801/3085828309","heartbeat_back_addr":"10.20.193.21:6803/3085828309","heartbeat_front_addr":"10.20.193.21:6802/3085828309","state":["exists","up"]},{"osd":9,"uuid":"10009b7b-f7e3-4f8b-b9cb-cff47b583dc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6800","nonce":3462355980}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6802","nonce":3462355980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6805","nonce":3462355980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6803","nonce":3462355980}]},"public_addr":"10.20.193.31:6800/3462355980","cluster_addr":"10.20.193.31:6802/3462355980","heartbeat_back_addr":"10.20.193.31:6805/3462355980","heartbeat_front_addr":"10.20.193.31:6803/3462355980","state":["exists","up"]},{"osd":10,"uuid":"1749f993-e477-46c7-8937-5b13265c7666","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":3680498089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":3680498089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":3680498089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":3680498089}]},"public_addr":"10.20.193.68:6800/3680498089","cluster_addr":"10.20.193.68:6801/3680498089","heartbeat_back_addr":"10.20.193.68:6803/3680498089","heartbeat_front_addr":"10.20.193.68:6802/3680498089","state":["exists","up"]},{"osd":11,"uuid":"7fa229a5-5207-4f26-859a-ea5890b2e939","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6809","nonce":3875035713}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6810","nonce":3875035713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6812","nonce":3875035713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6811","nonce":3875035713}]},"public_addr":"10.20.193.72:6809/3875035713","cluster_addr":"10.20.193.72:6810/3875035713","heartbeat_back_addr":"10.20.193.72:6812/3875035713","heartbeat_front_addr":"10.20.193.72:6811/3875035713","state":["exists","up"]},{"osd":12,"uuid":"d5cfb541-a088-4f8d-bfe4-923379407cfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6808","nonce":3798667347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6809","nonce":3798667347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6811","nonce":3798667347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.21:6810","nonce":3798667347}]},"public_addr":"10.20.193.21:6808/3798667347","cluster_addr":"10.20.193.21:6809/3798667347","heartbeat_back_addr":"10.20.193.21:6811/3798667347","heartbeat_front_addr":"10.20.193.21:6810/3798667347","state":["exists","up"]},{"osd":13,"uuid":"9fbaf977-6060-408d-b78e-eb4bf0f920c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6801","nonce":981225706}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6804","nonce":981225706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6807","nonce":981225706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.31:6806","nonce":981225706}]},"public_addr":"10.20.193.31:6801/981225706","cluster_addr":"10.20.193.31:6804/981225706","heartbeat_back_addr":"10.20.193.31:6807/981225706","heartbeat_front_addr":"10.20.193.31:6806/981225706","state":["exists","up"]},{"osd":14,"uuid":"4874b628-9885-489b-b19d-bc2454b19c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":3496291144}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":3496291144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":3496291144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":3496291144}]},"public_addr":"10.20.193.68:6804/3496291144","cluster_addr":"10.20.193.68:6805/3496291144","heartbeat_back_addr":"10.20.193.68:6807/3496291144","heartbeat_front_addr":"10.20.193.68:6806/3496291144","state":["exists","up"]},{"osd":15,"uuid":"bfa43094-6d74-4a8b-8ba1-4ae923d685a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":340,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6801","nonce":4086098431}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6802","nonce":4086098431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6804","nonce":4086098431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.72:6803","nonce":4086098431}]},"public_addr":"10.20.193.72:6801/4086098431","cluster_addr":"10.20.193.72:6802/4086098431","heartbeat_back_addr":"10.20.193.72:6804/4086098431","heartbeat_front_addr":"10.20.193.72:6803/4086098431","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.598722+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.723156+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.057755+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.069009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.642767+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.807896+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.996712+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.047731+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.574097+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.570580+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.761246+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:04.158222+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.717157+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.733104+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.936776+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T15:01:03.980030+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":2,"length":3}]},{"pool":16,"snaps":[{"begin":4,"length":3}]},{"pool":23,"snaps":[{"begin":1,"length":1}]},{"pool":67,"snaps":[{"begin":1,"length":1}]},{"pool":88,"snaps":[{"begin":7,"length":2}]},{"pool":99,"snaps":[{"begin":1,"length":1}]},{"pool":115,"snaps":[{"begin":1,"length":2}]},{"pool":129,"snaps":[{"begin":3,"length":1}]},{"pool":142,"snaps":[{"begin":2,"length":2}]},{"pool":143,"snaps":[{"begin":2,"length":3}]},{"pool":154,"snaps":[{"begin":2,"length":3}]},{"pool":158,"snaps":[{"begin":2,"length":1}]},{"pool":168,"snaps":[{"begin":2,"length":2}]},{"pool":169,"snaps":[{"begin":2,"length":4}]},{"pool":170,"snaps":[{"begin":1,"length":4}]},{"pool":183,"snaps":[{"begin":4,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T15:07:27.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 10 librados: watch_flush enter 2026-02-25T15:07:27.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 10 librados: watch_flush exit 2026-02-25T15:07:27.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 20 client.29134.objecter shutdown clearing up homeless session... 2026-02-25T15:07:27.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 10 client.29134.objecter successfully canceled tick 2026-02-25T15:07:27.700 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 >> v1:10.20.193.72:6800/2463505645 conn(0x7f9a8007a110 legacy=0x7f9a8009a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 10 monclient: shutdown 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 >> v1:10.20.193.31:6789/0 conn(0x7f9ab01613d0 legacy=0x7f9ab01fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 shutdown_connections 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.696+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 >> 10.20.193.21:0/564246057 conn(0x7f9ab00b65f0 msgr2=0x7f9ab0058b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.697+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 shutdown_connections 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.697+0000 7f9ab685c640 1 -- 10.20.193.21:0/564246057 wait complete. 2026-02-25T15:07:27.701 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:27.697+0000 7f9ab685c640 1 librados: shutdown 2026-02-25T15:07:28.708 INFO:tasks.ceph:Scrubbing osd.0 2026-02-25T15:07:28.709 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:28.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 10 monclient: get_monmap_and_config 2026-02-25T15:07:28.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 10 monclient: build_initial_monmap 2026-02-25T15:07:28.778 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 10 monclient: monmap: 2026-02-25T15:07:28.778 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:28.778 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:28.776779+0000 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:28.776779+0000 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 1 Processor -- start 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 1 -- start start 2026-02-25T15:07:28.779 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 10 monclient: init 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.776+0000 7f03b835d640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-c con 0x7f03b015e2a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-a con 0x7f03b0059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-b con 0x7f03b01a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b0162df0 con 0x7f03b0059e10 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b01630d0 con 0x7f03b01a5660 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b01633b0 con 0x7f03b015e2a0 2026-02-25T15:07:28.782 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b835d640 10 monclient(hunting): authenticate will time out at 3392.369066s 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b58d1640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f03b0059e10 0x7f03b015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50480/0 (socket says 10.20.193.21:50480) 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.777+0000 7f03b58d1640 1 -- 10.20.193.21:0/4011382634 learned_addr learned my addr 10.20.193.21:0/4011382634 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505341984 0 0) 0x7f03b0162df0 con 0x7f03b0059e10 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 10 monclient(hunting): my global_id is 28164 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.778+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0398003610 con 0x7f03b0059e10 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750345490 0 0) 0x7f03b01630d0 con 0x7f03b01a5660 2026-02-25T15:07:28.783 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): my global_id is 29137 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b0162df0 con 0x7f03b01a5660 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684112469 0 0) 0x7f03b01633b0 con 0x7f03b015e2a0 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 10 monclient(hunting): my global_id is 30791 2026-02-25T15:07:28.784 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.779+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b01630d0 con 0x7f03b015e2a0 2026-02-25T15:07:28.789 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 561627897 0 0) 0x7f03b0162df0 con 0x7f03b01a5660 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 >> v1:10.20.193.68:6789/0 conn(0x7f03b015e2a0 legacy=0x7f03b005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 >> v1:10.20.193.21:6789/0 conn(0x7f03b0059e10 legacy=0x7f03b015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: _finish_hunting 0 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 monclient: found mon.noname-b 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b0163690 con 0x7f03b01a5660 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: _finish_auth 0 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: _check_auth_tickets 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:28.790 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03ac003170 con 0x7f03b01a5660 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b50d0640 10 monclient: dump: 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.791 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b835d640 5 monclient: authenticate success, global_id 29137 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.780+0000 7f03b835d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03ac003340 con 0x7f03b01a5660 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 1 -- 10.20.193.21:0/4011382634 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03ac003780 con 0x7f03b01a5660 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b50d0640 10 monclient: dump: 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.792 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b835d640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.781+0000 7f03b835d640 4 set_mon_vals no callback set 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 10 monclient: shutdown 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:28.793 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- 10.20.193.21:0/4011382634 >> v1:10.20.193.31:6789/0 conn(0x7f03b01a5660 legacy=0x7f03b01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- 10.20.193.21:0/4011382634 shutdown_connections 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- 10.20.193.21:0/4011382634 >> 10.20.193.21:0/4011382634 conn(0x7f03b00b2f60 msgr2=0x7f03b00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- 10.20.193.21:0/4011382634 shutdown_connections 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- 10.20.193.21:0/4011382634 wait complete. 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 10 monclient: build_initial_monmap 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 10 monclient: monmap: 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:28.794 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 librados: starting msgr at 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 librados: starting objecter 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 Processor -- start 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 -- start start 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 librados: setting wanted keys 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 1 librados: calling monclient init 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.782+0000 7f03b835d640 10 monclient: init 2026-02-25T15:07:28.795 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-c con 0x7f03b0059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-b con 0x7f03b015e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient(hunting): picked mon.noname-a con 0x7f03b01a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b00b1490 con 0x7f03b01a5660 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b0195260 con 0x7f03b015e2a0 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b0195540 con 0x7f03b0059e10 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b835d640 10 monclient(hunting): authenticate will time out at 3392.375230s 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b68d3640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f03b01a5660 0x7f03b011db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50496/0 (socket says 10.20.193.21:50496) 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f03b68d3640 1 -- 10.20.193.21:0/2829966849 learned_addr learned my addr 10.20.193.21:0/2829966849 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:28.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f0396ffd640 10 client.?.objecter ms_handle_connect 0x7f03b01a5660 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f0396ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f0396ffd640 10 client.?.objecter ms_handle_connect 0x7f03b0059e10 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.783+0000 7f0396ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 client.?.objecter ms_handle_connect 0x7f03b015e2a0 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738743942 0 0) 0x7f03b00b1490 con 0x7f03b01a5660 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 10 monclient(hunting): my global_id is 28167 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.784+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0380003610 con 0x7f03b01a5660 2026-02-25T15:07:28.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904340360 0 0) 0x7f03b0195540 con 0x7f03b0059e10 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): my global_id is 30794 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b00b1490 con 0x7f03b0059e10 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417323537 0 0) 0x7f03b0195260 con 0x7f03b015e2a0 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 10 monclient(hunting): my global_id is 29140 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.785+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03b0195540 con 0x7f03b015e2a0 2026-02-25T15:07:28.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 223575470 0 0) 0x7f0380003610 con 0x7f03b01a5660 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03b0195260 con 0x7f03b01a5660 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03ac003690 con 0x7f03b01a5660 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.799 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 86744971 0 0) 0x7f03b0195540 con 0x7f03b015e2a0 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0380003610 con 0x7f03b015e2a0 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03a4002f30 con 0x7f03b015e2a0 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.800 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4244483356 0 0) 0x7f03b00b1490 con 0x7f03b0059e10 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f03b0195540 con 0x7f03b0059e10 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03a0003060 con 0x7f03b0059e10 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.801 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.787+0000 7f0396ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.802 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3340079743 0 0) 0x7f03b0195260 con 0x7f03b01a5660 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 >> v1:10.20.193.68:6789/0 conn(0x7f03b0059e10 legacy=0x7f03b00b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 >> v1:10.20.193.31:6789/0 conn(0x7f03b015e2a0 legacy=0x7f03b0192400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 1 monclient: found mon.a 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b0195820 con 0x7f03b01a5660 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:28.806 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f0396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 5 monclient: authenticate success, global_id 28167 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 10 monclient: _renew_subs 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03b0195b00 con 0x7f03b01a5660 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 10 client.28167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 10 monclient: _renew_subs 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f03b0191be0 con 0x7f03b01a5660 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.788+0000 7f03b835d640 1 librados: init done 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 10 client.28167.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 15 client.28167.objecter _session_command_op_assign -1 1 2026-02-25T15:07:28.807 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 20 client.28167.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 10 client.28167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.789+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f03b0195d40 con 0x7f03b01a5660 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03b0195d40 con 0x7f03b01a5660 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f03ac003ce0 con 0x7f03b01a5660 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 10 monclient: dump: 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.808 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f03b48cf640 4 set_mon_vals no callback set 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.798+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f03ac003ef0 con 0x7f03b01a5660 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.799+0000 7f03b60d2640 10 monclient: get_auth_request con 0x7f038007a0d0 auth_method 0 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.799+0000 7f0396ffd640 10 client.28167.objecter ms_handle_connect 0x7f038007a0d0 2026-02-25T15:07:28.809 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f03ac003ce0 con 0x7f03b01a5660 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 10 client.28167.objecter ms_dispatch2 0x7f03b0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 3 client.28167.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 3 client.28167.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 10 client.28167.objecter checking command 1 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter _get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 15 client.28167.objecter _session_command_op_remove -1 1 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter _get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 15 client.28167.objecter _session_command_op_assign 0 1 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 4 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 10 client.28167.objecter _send_command 1 2026-02-25T15:07:28.810 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6804/2253484549 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03800c6690 con 0x7f03800a4a30 2026-02-25T15:07:28.811 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 20 client.28167.objecter dump_active .. 0 homeless 2026-02-25T15:07:28.811 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f03ac05b1b0 con 0x7f03b01a5660 2026-02-25T15:07:28.811 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f0396ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:28.811 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.800+0000 7f03b58d1640 10 monclient: get_auth_request con 0x7f03800a4a30 auth_method 0 2026-02-25T15:07:28.811 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.801+0000 7f0396ffd640 10 client.28167.objecter ms_handle_connect 0x7f03800a4a30 2026-02-25T15:07:28.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.811+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== osd.0 v1:10.20.193.21:6804/2253484549 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f03800c6690 con 0x7f03800a4a30 2026-02-25T15:07:28.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.811+0000 7f0396ffd640 10 client.28167.objecter ms_dispatch2 0x7f03b0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:28.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.811+0000 7f0396ffd640 10 client.28167.objecter _finish_command 1 = system:0 2026-02-25T15:07:28.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.811+0000 7f0396ffd640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 4 2026-02-25T15:07:28.813 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.811+0000 7f0396ffd640 15 client.28167.objecter _session_command_op_remove 0 1 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 10 client.28167.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 15 client.28167.objecter _session_command_op_assign -1 2 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 20 client.28167.objecter _get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 20 client.28167.objecter _get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 15 client.28167.objecter _session_command_op_remove -1 2 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 20 client.28167.objecter get_session s=0x7f03800a4380 osd=0 3 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 15 client.28167.objecter _session_command_op_assign 0 2 2026-02-25T15:07:28.820 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 4 2026-02-25T15:07:28.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 10 client.28167.objecter _send_command 2 2026-02-25T15:07:28.821 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.818+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 --> v1:10.20.193.21:6804/2253484549 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f03b005db60 con 0x7f03800a4a30 2026-02-25T15:07:28.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f0396ffd640 1 -- 10.20.193.21:0/2829966849 <== osd.0 v1:10.20.193.21:6804/2253484549 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f03b005db60 con 0x7f03800a4a30 2026-02-25T15:07:28.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f0396ffd640 10 client.28167.objecter ms_dispatch2 0x7f03b0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:28.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f0396ffd640 10 client.28167.objecter _finish_command 2 = system:0 2026-02-25T15:07:28.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f0396ffd640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 4 2026-02-25T15:07:28.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f0396ffd640 15 client.28167.objecter _session_command_op_remove 0 2 2026-02-25T15:07:28.828 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:28.828 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:28.828 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:28.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 10 librados: watch_flush enter 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 10 librados: watch_flush exit 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 10 client.28167.objecter close_session for osd.0 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 >> v1:10.20.193.21:6804/2253484549 conn(0x7f03800a4a30 legacy=0x7f03800c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 20 client.28167.objecter put_session s=0x7f03800a4380 osd=0 1 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 20 client.28167.objecter shutdown clearing up homeless session... 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 10 client.28167.objecter successfully canceled tick 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 >> v1:10.20.193.72:6800/2463505645 conn(0x7f038007a0d0 legacy=0x7f038009a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 10 monclient: shutdown 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:28.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 >> v1:10.20.193.21:6789/0 conn(0x7f03b01a5660 legacy=0x7f03b011db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b68d3640 1 -- 10.20.193.21:0/2829966849 reap_dead start 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 shutdown_connections 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 >> 10.20.193.21:0/2829966849 conn(0x7f03b00b2f60 msgr2=0x7f03b00596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 shutdown_connections 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 -- 10.20.193.21:0/2829966849 wait complete. 2026-02-25T15:07:28.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.825+0000 7f03b835d640 1 librados: shutdown 2026-02-25T15:07:28.835 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 10 monclient: get_monmap_and_config 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 10 monclient: build_initial_monmap 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 10 monclient: monmap: 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.904 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:28.903169+0000 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:28.903169+0000 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:28.905 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 1 Processor -- start 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 1 -- start start 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.902+0000 7efdf5a08640 10 monclient: init 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:28.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-c con 0x7efdf015d070 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-a con 0x7efdf015d440 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-b con 0x7efdf0166f60 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf0164e60 con 0x7efdf015d440 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf00b1790 con 0x7efdf0166f60 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf00b1a70 con 0x7efdf015d070 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdf5a08640 10 monclient(hunting): authenticate will time out at 3392.495504s 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdee7fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7efdf015d440 0x7efdf0166850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50500/0 (socket says 10.20.193.21:50500) 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.903+0000 7efdee7fc640 1 -- 10.20.193.21:0/3034686024 learned_addr learned my addr 10.20.193.21:0/3034686024 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094011277 0 0) 0x7efdf00b1a70 con 0x7efdf015d070 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): my global_id is 30797 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efddc003610 con 0x7efdf015d070 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3619967280 0 0) 0x7efdf00b1790 con 0x7efdf0166f60 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): my global_id is 29143 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf00b1a70 con 0x7efdf0166f60 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596767800 0 0) 0x7efdf0164e60 con 0x7efdf015d440 2026-02-25T15:07:28.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 10 monclient(hunting): my global_id is 28170 2026-02-25T15:07:28.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.905+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf00b1790 con 0x7efdf015d440 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2802556307 0 0) 0x7efddc003610 con 0x7efdf015d070 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 >> v1:10.20.193.31:6789/0 conn(0x7efdf0166f60 legacy=0x7efdf00b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 >> v1:10.20.193.21:6789/0 conn(0x7efdf015d440 legacy=0x7efdf0166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 monclient: found mon.noname-c 2026-02-25T15:07:28.914 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf00b1d50 con 0x7efdf015d070 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efde4002df0 con 0x7efdf015d070 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdedffb640 10 monclient: dump: 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.915 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdf5a08640 5 monclient: authenticate success, global_id 30797 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.906+0000 7efdf5a08640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efde4002fc0 con 0x7efdf015d070 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:28.916 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 1 -- 10.20.193.21:0/3034686024 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efde4003400 con 0x7efdf015d070 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdedffb640 10 monclient: dump: 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.917 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdf5a08640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.907+0000 7efdf5a08640 4 set_mon_vals no callback set 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 10 monclient: shutdown 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 -- 10.20.193.21:0/3034686024 >> v1:10.20.193.68:6789/0 conn(0x7efdf015d070 legacy=0x7efdf0164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 -- 10.20.193.21:0/3034686024 shutdown_connections 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 -- 10.20.193.21:0/3034686024 >> 10.20.193.21:0/3034686024 conn(0x7efdf00b2ef0 msgr2=0x7efdf00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 -- 10.20.193.21:0/3034686024 shutdown_connections 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 -- 10.20.193.21:0/3034686024 wait complete. 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 10 monclient: build_initial_monmap 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 10 monclient: monmap: 2026-02-25T15:07:28.918 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 librados: starting msgr at 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.908+0000 7efdf5a08640 1 librados: starting objecter 2026-02-25T15:07:28.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 Processor -- start 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 -- start start 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 librados: setting wanted keys 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 librados: calling monclient init 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient: init 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-a con 0x7efdf015d070 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-b con 0x7efdf015d440 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient(hunting): picked mon.noname-c con 0x7efdf0166f60 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf012b1a0 con 0x7efdf015d070 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf0129710 con 0x7efdf015d440 2026-02-25T15:07:28.920 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf01299f0 con 0x7efdf0166f60 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdf5a08640 10 monclient(hunting): authenticate will time out at 3392.501450s 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdeeffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7efdf015d070 0x7efdf012bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:50512/0 (socket says 10.20.193.21:50512) 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.909+0000 7efdeeffd640 1 -- 10.20.193.21:0/4086367282 learned_addr learned my addr 10.20.193.21:0/4086367282 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter ms_handle_connect 0x7efdf015d070 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter ms_handle_connect 0x7efdf0166f60 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter ms_handle_connect 0x7efdf015d440 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.910+0000 7efdc7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235928099 0 0) 0x7efdf01299f0 con 0x7efdf0166f60 2026-02-25T15:07:28.921 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): my global_id is 30800 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc0003610 con 0x7efdf0166f60 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372833040 0 0) 0x7efdf0129710 con 0x7efdf015d440 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): my global_id is 29146 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf01299f0 con 0x7efdf015d440 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916411639 0 0) 0x7efdf012b1a0 con 0x7efdf015d070 2026-02-25T15:07:28.922 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:28.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:28.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:28.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 10 monclient(hunting): my global_id is 28173 2026-02-25T15:07:28.923 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.911+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf0129710 con 0x7efdf015d070 2026-02-25T15:07:28.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 904330901 0 0) 0x7efdc0003610 con 0x7efdf0166f60 2026-02-25T15:07:28.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf012b1a0 con 0x7efdf0166f60 2026-02-25T15:07:28.925 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efde00032f0 con 0x7efdf0166f60 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.926 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4156651170 0 0) 0x7efdf0129710 con 0x7efdf015d070 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdc0003610 con 0x7efdf015d070 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efde4003310 con 0x7efdf015d070 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.913+0000 7efdc7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.927 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3559139896 0 0) 0x7efdf01299f0 con 0x7efdf015d440 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf0129710 con 0x7efdf015d440 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efdd8003090 con 0x7efdf015d440 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:28.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.914+0000 7efdc7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4182278279 0 0) 0x7efdf012b1a0 con 0x7efdf0166f60 2026-02-25T15:07:28.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 >> v1:10.20.193.31:6789/0 conn(0x7efdf015d440 legacy=0x7efdf012aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 >> v1:10.20.193.21:6789/0 conn(0x7efdf015d070 legacy=0x7efdf012bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 1 monclient: found mon.c 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf0129cd0 con 0x7efdf0166f60 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 10 monclient: _finish_auth 0 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdc7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 5 monclient: authenticate success, global_id 30800 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 10 monclient: _renew_subs 2026-02-25T15:07:28.930 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdf0129fb0 con 0x7efdf0166f60 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 10 client.30800.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 10 monclient: _renew_subs 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efdf012a570 con 0x7efdf0166f60 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.915+0000 7efdf5a08640 1 librados: init done 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.916+0000 7efdf5a08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.916+0000 7efdf5a08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.916+0000 7efdf5a08640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:28.931 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:28.916+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf00531e0 con 0x7efdf0166f60 2026-02-25T15:07:29.008 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efde0003490 con 0x7efdf0166f60 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efde0003b30 con 0x7efdf0166f60 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efdc7fff640 10 monclient: dump: 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.009 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.006+0000 7efded7fa640 4 set_mon_vals no callback set 2026-02-25T15:07:29.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.007+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7efde001d050 con 0x7efdf0166f60 2026-02-25T15:07:29.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.008+0000 7efdeeffd640 10 monclient: get_auth_request con 0x7efdc007a040 auth_method 0 2026-02-25T15:07:29.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.008+0000 7efdc7fff640 10 client.30800.objecter ms_handle_connect 0x7efdc007a040 2026-02-25T15:07:29.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.009+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7efde0094b00 con 0x7efdf0166f60 2026-02-25T15:07:29.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.009+0000 7efdc7fff640 10 client.30800.objecter ms_dispatch2 0x7efdf0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.009+0000 7efdc7fff640 3 client.30800.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.009+0000 7efdc7fff640 3 client.30800.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.009+0000 7efdc7fff640 20 client.30800.objecter dump_active .. 0 homeless 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.010+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7efdf00531e0 con 0x7efdf0166f60 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.010+0000 7efdc7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.010+0000 7efdc7fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:29.118 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.116+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7efdf01679a0 con 0x7efdc007a040 2026-02-25T15:07:29.119 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.116+0000 7efdc7fff640 1 -- 10.20.193.21:0/4086367282 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7efdf01679a0 con 0x7efdc007a040 2026-02-25T15:07:29.119 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 0 to deep-scrub 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 10 librados: watch_flush enter 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 10 librados: watch_flush exit 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 20 client.30800.objecter shutdown clearing up homeless session... 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 10 client.30800.objecter successfully canceled tick 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 >> v1:10.20.193.72:6800/2463505645 conn(0x7efdc007a040 legacy=0x7efdc009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 10 monclient: shutdown 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 >> v1:10.20.193.68:6789/0 conn(0x7efdf0166f60 legacy=0x7efdf015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.121 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 shutdown_connections 2026-02-25T15:07:29.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 >> 10.20.193.21:0/4086367282 conn(0x7efdf00b2ef0 msgr2=0x7efdf015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 shutdown_connections 2026-02-25T15:07:29.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 -- 10.20.193.21:0/4086367282 wait complete. 2026-02-25T15:07:29.122 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.118+0000 7efdf5a08640 1 librados: shutdown 2026-02-25T15:07:29.129 INFO:tasks.ceph:Scrubbing osd.4 2026-02-25T15:07:29.129 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:29.199 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 10 monclient: get_monmap_and_config 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 10 monclient: monmap: 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:29.198028+0000 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:29.198028+0000 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.200 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.201 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 1 Processor -- start 2026-02-25T15:07:29.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 1 -- start start 2026-02-25T15:07:29.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.197+0000 7f5aaa632640 10 monclient: init 2026-02-25T15:07:29.206 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-b con 0x7f5aa415e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-c con 0x7f5aa4059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-a con 0x7f5aa41a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa4162df0 con 0x7f5aa41a5660 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa41630d0 con 0x7f5aa415e2a0 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa41633b0 con 0x7f5aa4059e10 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.207 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aaa632640 10 monclient(hunting): authenticate will time out at 3392.790387s 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aa8ba8640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5aa41a5660 0x7f5aa41c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43170/0 (socket says 10.20.193.21:43170) 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.198+0000 7f5aa8ba8640 1 -- 10.20.193.21:0/1181283282 learned_addr learned my addr 10.20.193.21:0/1181283282 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735459808 0 0) 0x7f5aa41633b0 con 0x7f5aa4059e10 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): my global_id is 30803 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a88003610 con 0x7f5aa4059e10 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609588920 0 0) 0x7f5aa4162df0 con 0x7f5aa41a5660 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): my global_id is 28176 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa41633b0 con 0x7f5aa41a5660 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311820255 0 0) 0x7f5aa41630d0 con 0x7f5aa415e2a0 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.208 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 10 monclient(hunting): my global_id is 29149 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.200+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa4162df0 con 0x7f5aa415e2a0 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3734693787 0 0) 0x7f5a88003610 con 0x7f5aa4059e10 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 >> v1:10.20.193.31:6789/0 conn(0x7f5aa415e2a0 legacy=0x7f5aa405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 >> v1:10.20.193.21:6789/0 conn(0x7f5aa41a5660 legacy=0x7f5aa41c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 monclient: found mon.noname-c 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa4163690 con 0x7f5aa4059e10 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a94002df0 con 0x7f5aa4059e10 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aa2ffd640 10 monclient: dump: 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.209 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aaa632640 5 monclient: authenticate success, global_id 30803 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.201+0000 7f5aaa632640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a94002fc0 con 0x7f5aa4059e10 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 1 -- 10.20.193.21:0/1181283282 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a94003400 con 0x7f5aa4059e10 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 4 set_mon_vals no callback set 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aa2ffd640 10 monclient: dump: 2026-02-25T15:07:29.210 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 10 monclient: shutdown 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.211 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 1 -- 10.20.193.21:0/1181283282 >> v1:10.20.193.68:6789/0 conn(0x7f5aa4059e10 legacy=0x7f5aa415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 1 -- 10.20.193.21:0/1181283282 shutdown_connections 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 1 -- 10.20.193.21:0/1181283282 >> 10.20.193.21:0/1181283282 conn(0x7f5aa40b2f60 msgr2=0x7f5aa40b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.202+0000 7f5aaa632640 1 -- 10.20.193.21:0/1181283282 shutdown_connections 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 -- 10.20.193.21:0/1181283282 wait complete. 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 10 monclient: monmap: 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.212 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 librados: starting msgr at 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 librados: starting objecter 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 Processor -- start 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 -- start start 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 librados: setting wanted keys 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 1 librados: calling monclient init 2026-02-25T15:07:29.213 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.203+0000 7f5aaa632640 10 monclient: init 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-c con 0x7f5aa4059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-b con 0x7f5aa415e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient(hunting): picked mon.noname-a con 0x7f5aa41a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa4129470 con 0x7f5aa41a5660 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa4129750 con 0x7f5aa415e2a0 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aa4129a30 con 0x7f5aa4059e10 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aaa632640 10 monclient(hunting): authenticate will time out at 3392.796181s 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa37fe640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f5aa415e2a0 0x7f5aa40b1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48382/0 (socket says 10.20.193.21:48382) 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa37fe640 1 -- 10.20.193.21:0/2455885873 learned_addr learned my addr 10.20.193.21:0/2455885873 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.214 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa0ff9640 10 client.?.objecter ms_handle_connect 0x7f5aa415e2a0 2026-02-25T15:07:29.215 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.215 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa0ff9640 10 client.?.objecter ms_handle_connect 0x7f5aa4059e10 2026-02-25T15:07:29.215 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.204+0000 7f5aa0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.215 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 client.?.objecter ms_handle_connect 0x7f5aa41a5660 2026-02-25T15:07:29.215 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3461324114 0 0) 0x7f5aa4129a30 con 0x7f5aa4059e10 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): my global_id is 30806 2026-02-25T15:07:29.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a74003610 con 0x7f5aa4059e10 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659422894 0 0) 0x7f5aa4129750 con 0x7f5aa415e2a0 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 10 monclient(hunting): my global_id is 29152 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.205+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa4129a30 con 0x7f5aa415e2a0 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720489275 0 0) 0x7f5aa4129470 con 0x7f5aa41a5660 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 10 monclient(hunting): my global_id is 28179 2026-02-25T15:07:29.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.206+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa4129750 con 0x7f5aa41a5660 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1121762121 0 0) 0x7f5a74003610 con 0x7f5aa4059e10 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aa4129470 con 0x7f5aa4059e10 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a90003060 con 0x7f5aa4059e10 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.221 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2796227280 0 0) 0x7f5aa4129a30 con 0x7f5aa415e2a0 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a74003610 con 0x7f5aa415e2a0 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a94003310 con 0x7f5aa415e2a0 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.222 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 272034395 0 0) 0x7f5aa4129750 con 0x7f5aa41a5660 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aa4129a30 con 0x7f5aa41a5660 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a98003360 con 0x7f5aa41a5660 2026-02-25T15:07:29.223 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.208+0000 7f5aa0ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.224 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3717902270 0 0) 0x7f5aa4129470 con 0x7f5aa4059e10 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 >> v1:10.20.193.31:6789/0 conn(0x7f5aa415e2a0 legacy=0x7f5aa40b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 >> v1:10.20.193.21:6789/0 conn(0x7f5aa41a5660 legacy=0x7f5aa414c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 1 monclient: found mon.c 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa4129d10 con 0x7f5aa4059e10 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aa0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aaa632640 5 monclient: authenticate success, global_id 30806 2026-02-25T15:07:29.225 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aaa632640 10 monclient: _renew_subs 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aaa632640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.209+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5aa4129ff0 con 0x7f5aa4059e10 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 client.30806.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 monclient: _renew_subs 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5aa4191ea0 con 0x7f5aa4059e10 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 1 librados: init done 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 client.30806.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 15 client.30806.objecter _session_command_op_assign -1 1 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 20 client.30806.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 client.30806.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.226 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.210+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5aa41a4990 con 0x7f5aa4059e10 2026-02-25T15:07:29.228 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5aa41a4990 con 0x7f5aa4059e10 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5a900038a0 con 0x7f5aa4059e10 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa0ff9640 10 monclient: dump: 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.229 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.218+0000 7f5aa27fc640 4 set_mon_vals no callback set 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.219+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f5a9001cd80 con 0x7f5aa4059e10 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa37fe640 10 monclient: get_auth_request con 0x7f5a74079ff0 auth_method 0 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 10 client.30806.objecter ms_handle_connect 0x7f5a74079ff0 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f5a900946f0 con 0x7f5aa4059e10 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 10 client.30806.objecter ms_dispatch2 0x7f5aa4000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 3 client.30806.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:29.230 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 3 client.30806.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 10 client.30806.objecter checking command 1 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter _get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 15 client.30806.objecter _session_command_op_remove -1 1 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter _get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 15 client.30806.objecter _session_command_op_assign 4 1 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 4 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 10 client.30806.objecter _send_command 1 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.21:6812/2726560095 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a740c65b0 con 0x7f5a740a4950 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 20 client.30806.objecter dump_active .. 0 homeless 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f5a90059cc0 con 0x7f5aa4059e10 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.220+0000 7f5aa0ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:29.231 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.221+0000 7f5aa8ba8640 10 monclient: get_auth_request con 0x7f5a740a4950 auth_method 0 2026-02-25T15:07:29.232 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.222+0000 7f5aa0ff9640 10 client.30806.objecter ms_handle_connect 0x7f5a740a4950 2026-02-25T15:07:29.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.232+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== osd.4 v1:10.20.193.21:6812/2726560095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5a740c65b0 con 0x7f5a740a4950 2026-02-25T15:07:29.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.232+0000 7f5aa0ff9640 10 client.30806.objecter ms_dispatch2 0x7f5aa4000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:29.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.232+0000 7f5aa0ff9640 10 client.30806.objecter _finish_command 1 = system:0 2026-02-25T15:07:29.234 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.232+0000 7f5aa0ff9640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 4 2026-02-25T15:07:29.235 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.232+0000 7f5aa0ff9640 15 client.30806.objecter _session_command_op_remove 4 1 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 10 client.30806.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 15 client.30806.objecter _session_command_op_assign -1 2 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 20 client.30806.objecter _get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 20 client.30806.objecter _get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.242 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 15 client.30806.objecter _session_command_op_remove -1 2 2026-02-25T15:07:29.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 20 client.30806.objecter get_session s=0x7f5a740a42a0 osd=4 3 2026-02-25T15:07:29.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 15 client.30806.objecter _session_command_op_assign 4 2 2026-02-25T15:07:29.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 4 2026-02-25T15:07:29.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 10 client.30806.objecter _send_command 2 2026-02-25T15:07:29.243 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.239+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 --> v1:10.20.193.21:6812/2726560095 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5aa40b73f0 con 0x7f5a740a4950 2026-02-25T15:07:29.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa0ff9640 1 -- 10.20.193.21:0/2455885873 <== osd.4 v1:10.20.193.21:6812/2726560095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f5aa40b73f0 con 0x7f5a740a4950 2026-02-25T15:07:29.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa0ff9640 10 client.30806.objecter ms_dispatch2 0x7f5aa4000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:29.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa0ff9640 10 client.30806.objecter _finish_command 2 = system:0 2026-02-25T15:07:29.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa0ff9640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 4 2026-02-25T15:07:29.250 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa0ff9640 15 client.30806.objecter _session_command_op_remove 4 2 2026-02-25T15:07:29.250 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:29.250 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:29.250 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 10 librados: watch_flush enter 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 10 librados: watch_flush exit 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 10 client.30806.objecter close_session for osd.4 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 >> v1:10.20.193.21:6812/2726560095 conn(0x7f5a740a4950 legacy=0x7f5a740c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 20 client.30806.objecter put_session s=0x7f5a740a42a0 osd=4 1 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 20 client.30806.objecter shutdown clearing up homeless session... 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 10 client.30806.objecter successfully canceled tick 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 >> v1:10.20.193.72:6800/2463505645 conn(0x7f5a74079ff0 legacy=0x7f5a7409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 10 monclient: shutdown 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 >> v1:10.20.193.68:6789/0 conn(0x7f5aa4059e10 legacy=0x7f5aa412a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aa8ba8640 1 -- 10.20.193.21:0/2455885873 reap_dead start 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 shutdown_connections 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.247+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 >> 10.20.193.21:0/2455885873 conn(0x7f5aa40b2f60 msgr2=0x7f5aa415d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.248+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 shutdown_connections 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.248+0000 7f5aaa632640 1 -- 10.20.193.21:0/2455885873 wait complete. 2026-02-25T15:07:29.253 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.248+0000 7f5aaa632640 1 librados: shutdown 2026-02-25T15:07:29.257 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-25T15:07:29.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 10 monclient: get_monmap_and_config 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 10 monclient: monmap: 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:29.323826+0000 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:29.323826+0000 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.325 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.326 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.326 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.326 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.326 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 1 Processor -- start 2026-02-25T15:07:29.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 1 -- start start 2026-02-25T15:07:29.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.323+0000 7fe9e7c67640 10 monclient: init 2026-02-25T15:07:29.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-c con 0x7fe9e0157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-b con 0x7fe9e0157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-a con 0x7fe9e0164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e005de70 con 0x7fe9e0164d00 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e0055b20 con 0x7fe9e0157b50 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e0055e00 con 0x7fe9e0157780 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e7c67640 10 monclient(hunting): authenticate will time out at 3392.916159s 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e59dc640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fe9e0157780 0x7fe9e0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:47770/0 (socket says 10.20.193.21:47770) 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.324+0000 7fe9e59dc640 1 -- 10.20.193.21:0/2092648449 learned_addr learned my addr 10.20.193.21:0/2092648449 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798360682 0 0) 0x7fe9e0055e00 con 0x7fe9e0157780 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 10 monclient(hunting): my global_id is 30809 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.325+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9c8003610 con 0x7fe9e0157780 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351618342 0 0) 0x7fe9e005de70 con 0x7fe9e0164d00 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): my global_id is 28182 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0055e00 con 0x7fe9e0164d00 2026-02-25T15:07:29.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026867347 0 0) 0x7fe9e0055b20 con 0x7fe9e0157b50 2026-02-25T15:07:29.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 10 monclient(hunting): my global_id is 29155 2026-02-25T15:07:29.331 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.326+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e005de70 con 0x7fe9e0157b50 2026-02-25T15:07:29.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 261937131 0 0) 0x7fe9c8003610 con 0x7fe9e0157780 2026-02-25T15:07:29.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 >> v1:10.20.193.31:6789/0 conn(0x7fe9e0157b50 legacy=0x7fe9e01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 >> v1:10.20.193.21:6789/0 conn(0x7fe9e0164d00 legacy=0x7fe9e01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.335 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 monclient: found mon.noname-c 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e00560e0 con 0x7fe9e0157780 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9d0002df0 con 0x7fe9e0157780 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e49da640 10 monclient: dump: 2026-02-25T15:07:29.336 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e7c67640 5 monclient: authenticate success, global_id 30809 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.327+0000 7fe9e7c67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9d0002fc0 con 0x7fe9e0157780 2026-02-25T15:07:29.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 1 -- 10.20.193.21:0/2092648449 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9d0003400 con 0x7fe9e0157780 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e49da640 10 monclient: dump: 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.338 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 4 set_mon_vals no callback set 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 10 monclient: shutdown 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 1 -- 10.20.193.21:0/2092648449 >> v1:10.20.193.68:6789/0 conn(0x7fe9e0157780 legacy=0x7fe9e0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 1 -- 10.20.193.21:0/2092648449 shutdown_connections 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 1 -- 10.20.193.21:0/2092648449 >> 10.20.193.21:0/2092648449 conn(0x7fe9e00b2ef0 msgr2=0x7fe9e00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 1 -- 10.20.193.21:0/2092648449 shutdown_connections 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.328+0000 7fe9e7c67640 1 -- 10.20.193.21:0/2092648449 wait complete. 2026-02-25T15:07:29.339 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient: monmap: 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 librados: starting msgr at 2026-02-25T15:07:29.340 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 librados: starting objecter 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 Processor -- start 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 -- start start 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 librados: setting wanted keys 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 librados: calling monclient init 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient: init 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-c con 0x7fe9e0157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-b con 0x7fe9e0157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient(hunting): picked mon.noname-a con 0x7fe9e0164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.341 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e014a020 con 0x7fe9e0164d00 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e014a300 con 0x7fe9e0157b50 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e0145fb0 con 0x7fe9e0157780 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.329+0000 7fe9e7c67640 10 monclient(hunting): authenticate will time out at 3392.921964s 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9e61dd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe9e0164d00 0x7fe9e0149530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43192/0 (socket says 10.20.193.21:43192) 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9e61dd640 1 -- 10.20.193.21:0/4276774546 learned_addr learned my addr 10.20.193.21:0/4276774546 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter ms_handle_connect 0x7fe9e0157780 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter ms_handle_connect 0x7fe9e0164d00 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter ms_handle_connect 0x7fe9e0157b50 2026-02-25T15:07:29.342 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.330+0000 7fe9ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774671321 0 0) 0x7fe9e0145fb0 con 0x7fe9e0157780 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): my global_id is 30812 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9b0003610 con 0x7fe9e0157780 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832390235 0 0) 0x7fe9e014a020 con 0x7fe9e0164d00 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): my global_id is 28185 2026-02-25T15:07:29.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0145fb0 con 0x7fe9e0164d00 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261148079 0 0) 0x7fe9e014a300 con 0x7fe9e0157b50 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 10 monclient(hunting): my global_id is 29158 2026-02-25T15:07:29.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.331+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e014a020 con 0x7fe9e0157b50 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3495854358 0 0) 0x7fe9b0003610 con 0x7fe9e0157780 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9e014a300 con 0x7fe9e0157780 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9d0003310 con 0x7fe9e0157780 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.348 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.349 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1881973935 0 0) 0x7fe9e014a020 con 0x7fe9e0157b50 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9b0003610 con 0x7fe9e0157b50 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9d4003060 con 0x7fe9e0157b50 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.350 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1779304001 0 0) 0x7fe9e0145fb0 con 0x7fe9e0164d00 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe9e014a020 con 0x7fe9e0164d00 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9dc003370 con 0x7fe9e0164d00 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.334+0000 7fe9ce7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.351 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 890237010 0 0) 0x7fe9e014a300 con 0x7fe9e0157780 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 >> v1:10.20.193.31:6789/0 conn(0x7fe9e0157b50 legacy=0x7fe9e013e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 >> v1:10.20.193.21:6789/0 conn(0x7fe9e0164d00 legacy=0x7fe9e0149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 1 monclient: found mon.c 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e0146290 con 0x7fe9e0157780 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 5 monclient: authenticate success, global_id 30812 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 10 monclient: _renew_subs 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e0146570 con 0x7fe9e0157780 2026-02-25T15:07:29.353 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 10 client.30812.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 10 monclient: _renew_subs 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe9e0156f80 con 0x7fe9e0157780 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.335+0000 7fe9e7c67640 1 librados: init done 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.336+0000 7fe9e7c67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.336+0000 7fe9e7c67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.336+0000 7fe9e7c67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.336+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e005e250 con 0x7fe9e0157780 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9d0002fc0 con 0x7fe9e0157780 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe9d0004d20 con 0x7fe9e0157780 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9ce7fc640 10 monclient: dump: 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.343+0000 7fe9cffff640 4 set_mon_vals no callback set 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.344+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe9d001e200 con 0x7fe9e0157780 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9e51db640 10 monclient: get_auth_request con 0x7fe9b007a0d0 auth_method 0 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 10 client.30812.objecter ms_handle_connect 0x7fe9b007a0d0 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fe9d00959d0 con 0x7fe9e0157780 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 10 client.30812.objecter ms_dispatch2 0x7fe9e0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 3 client.30812.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 3 client.30812.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:29.356 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.345+0000 7fe9ce7fc640 20 client.30812.objecter dump_active .. 0 homeless 2026-02-25T15:07:29.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.430+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe9e005e250 con 0x7fe9e0157780 2026-02-25T15:07:29.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.430+0000 7fe9ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.430+0000 7fe9ce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:29.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.535+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fe9e005a1c0 con 0x7fe9b007a0d0 2026-02-25T15:07:29.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.535+0000 7fe9ce7fc640 1 -- 10.20.193.21:0/4276774546 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fe9e005a1c0 con 0x7fe9b007a0d0 2026-02-25T15:07:29.537 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 4 to deep-scrub 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 10 librados: watch_flush enter 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 10 librados: watch_flush exit 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 20 client.30812.objecter shutdown clearing up homeless session... 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 10 client.30812.objecter successfully canceled tick 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe9b007a0d0 legacy=0x7fe9b009a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 10 monclient: shutdown 2026-02-25T15:07:29.539 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 >> v1:10.20.193.68:6789/0 conn(0x7fe9e0157780 legacy=0x7fe9e0137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 shutdown_connections 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 >> 10.20.193.21:0/4276774546 conn(0x7fe9e00b2ef0 msgr2=0x7fe9e005ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 shutdown_connections 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 -- 10.20.193.21:0/4276774546 wait complete. 2026-02-25T15:07:29.540 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.536+0000 7fe9e7c67640 1 librados: shutdown 2026-02-25T15:07:29.547 INFO:tasks.ceph:Scrubbing osd.8 2026-02-25T15:07:29.548 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:29.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 10 monclient: get_monmap_and_config 2026-02-25T15:07:29.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 10 monclient: monmap: 2026-02-25T15:07:29.618 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:29.615912+0000 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:29.615912+0000 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 1 Processor -- start 2026-02-25T15:07:29.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 1 -- start start 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.615+0000 7f48e26b9640 10 monclient: init 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-a con 0x7f48dc15e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-b con 0x7f48dc059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-c con 0x7f48dc1a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc162df0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc1630d0 con 0x7f48dc059e10 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc1633b0 con 0x7f48dc1a5660 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48e26b9640 10 monclient(hunting): authenticate will time out at 3393.208196s 2026-02-25T15:07:29.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48dbfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f48dc15e2a0 0x7f48dc05da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43204/0 (socket says 10.20.193.21:43204) 2026-02-25T15:07:29.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.616+0000 7f48dbfff640 1 -- 10.20.193.21:0/109171544 learned_addr learned my addr 10.20.193.21:0/109171544 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.626 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922249283 0 0) 0x7f48dc162df0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.626 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.626 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.626 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): my global_id is 28188 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48c0003610 con 0x7f48dc15e2a0 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491412530 0 0) 0x7f48dc1633b0 con 0x7f48dc1a5660 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): my global_id is 30815 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc162df0 con 0x7f48dc1a5660 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801003544 0 0) 0x7f48dc1630d0 con 0x7f48dc059e10 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.627 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 10 monclient(hunting): my global_id is 29161 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.618+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc1633b0 con 0x7f48dc059e10 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830081555 0 0) 0x7f48dc162df0 con 0x7f48dc1a5660 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 >> v1:10.20.193.31:6789/0 conn(0x7f48dc059e10 legacy=0x7f48dc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 >> v1:10.20.193.21:6789/0 conn(0x7f48dc15e2a0 legacy=0x7f48dc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 monclient: found mon.noname-c 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc163690 con 0x7f48dc1a5660 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.628 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48d0003170 con 0x7f48dc1a5660 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48e26b9640 5 monclient: authenticate success, global_id 30815 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48e26b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48daffd640 10 monclient: dump: 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.629 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.619+0000 7f48e26b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48d0003340 con 0x7f48dc1a5660 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 1 -- 10.20.193.21:0/109171544 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48d0003780 con 0x7f48dc1a5660 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48e26b9640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48e26b9640 4 set_mon_vals no callback set 2026-02-25T15:07:29.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.620+0000 7f48daffd640 10 monclient: dump: 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 10 monclient: shutdown 2026-02-25T15:07:29.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- 10.20.193.21:0/109171544 >> v1:10.20.193.68:6789/0 conn(0x7f48dc1a5660 legacy=0x7f48dc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- 10.20.193.21:0/109171544 shutdown_connections 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- 10.20.193.21:0/109171544 >> 10.20.193.21:0/109171544 conn(0x7f48dc0b2f60 msgr2=0x7f48dc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- 10.20.193.21:0/109171544 shutdown_connections 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- 10.20.193.21:0/109171544 wait complete. 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 10 monclient: monmap: 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:29.632 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 librados: starting msgr at 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 librados: starting objecter 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 Processor -- start 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 -- start start 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 librados: setting wanted keys 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 1 librados: calling monclient init 2026-02-25T15:07:29.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.621+0000 7f48e26b9640 10 monclient: init 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-c con 0x7f48dc059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-a con 0x7f48dc15e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient(hunting): picked mon.noname-b con 0x7f48dc1a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0b24f0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0a7970 con 0x7f48dc1a5660 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0a7c50 con 0x7f48dc059e10 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48e26b9640 10 monclient(hunting): authenticate will time out at 3393.214442s 2026-02-25T15:07:29.634 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48db7fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f48dc15e2a0 0x7f48dc1941b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43220/0 (socket says 10.20.193.21:43220) 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48db7fe640 1 -- 10.20.193.21:0/2656576638 learned_addr learned my addr 10.20.193.21:0/2656576638 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48d8ff9640 10 client.?.objecter ms_handle_connect 0x7f48dc15e2a0 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.622+0000 7f48d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 client.?.objecter ms_handle_connect 0x7f48dc059e10 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 client.?.objecter ms_handle_connect 0x7f48dc1a5660 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065576819 0 0) 0x7f48dc0b24f0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): my global_id is 28191 2026-02-25T15:07:29.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48ac003610 con 0x7f48dc15e2a0 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951977625 0 0) 0x7f48dc0a7c50 con 0x7f48dc059e10 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 10 monclient(hunting): my global_id is 30818 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.623+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc0b24f0 con 0x7f48dc059e10 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602801232 0 0) 0x7f48dc0a7970 con 0x7f48dc1a5660 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 10 monclient(hunting): my global_id is 29164 2026-02-25T15:07:29.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.624+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc0a7c50 con 0x7f48dc1a5660 2026-02-25T15:07:29.640 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4184387891 0 0) 0x7f48dc0b24f0 con 0x7f48dc059e10 2026-02-25T15:07:29.640 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48dc0a7970 con 0x7f48dc059e10 2026-02-25T15:07:29.640 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48c80030b0 con 0x7f48dc059e10 2026-02-25T15:07:29.640 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.640 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.641 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1304434130 0 0) 0x7f48ac003610 con 0x7f48dc15e2a0 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48dc0b24f0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48cc0030c0 con 0x7f48dc15e2a0 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.626+0000 7f48d8ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.642 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292740285 0 0) 0x7f48dc0a7c50 con 0x7f48dc1a5660 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48ac003610 con 0x7f48dc1a5660 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48d0003690 con 0x7f48dc1a5660 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.643 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1194197665 0 0) 0x7f48dc0a7970 con 0x7f48dc059e10 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 >> v1:10.20.193.31:6789/0 conn(0x7f48dc1a5660 legacy=0x7f48dc12a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 >> v1:10.20.193.21:6789/0 conn(0x7f48dc15e2a0 legacy=0x7f48dc1941b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.644 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 monclient: found mon.c 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0a7f30 con 0x7f48dc059e10 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 5 monclient: authenticate success, global_id 30818 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 10 monclient: _renew_subs 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc0a8210 con 0x7f48dc059e10 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 10 client.30818.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 10 monclient: _renew_subs 2026-02-25T15:07:29.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f48dc0a87d0 con 0x7f48dc059e10 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.627+0000 7f48e26b9640 1 librados: init done 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 10 client.30818.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 15 client.30818.objecter _session_command_op_assign -1 1 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 20 client.30818.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 10 client.30818.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.628+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f48dc0b27a0 con 0x7f48dc059e10 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48dc0b27a0 con 0x7f48dc059e10 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f48c8004a70 con 0x7f48dc059e10 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48d8ff9640 10 monclient: dump: 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.647 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.635+0000 7f48da7fc640 4 set_mon_vals no callback set 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.636+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f48c801df50 con 0x7f48dc059e10 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48db7fe640 10 monclient: get_auth_request con 0x7f48ac07a040 auth_method 0 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 10 client.30818.objecter ms_handle_connect 0x7f48ac07a040 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f48c8095880 con 0x7f48dc059e10 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 10 client.30818.objecter ms_dispatch2 0x7f48dc000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 3 client.30818.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 3 client.30818.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 10 client.30818.objecter checking command 1 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter _get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 15 client.30818.objecter _session_command_op_remove -1 1 2026-02-25T15:07:29.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter _get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 15 client.30818.objecter _session_command_op_assign 8 1 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 4 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 10 client.30818.objecter _send_command 1 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.21:6800/3085828309 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48ac0c6600 con 0x7f48ac0a49a0 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 20 client.30818.objecter dump_active .. 0 homeless 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f48c805ae50 con 0x7f48dc059e10 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.637+0000 7f48d8ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:29.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.638+0000 7f48e0c2f640 10 monclient: get_auth_request con 0x7f48ac0a49a0 auth_method 0 2026-02-25T15:07:29.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.639+0000 7f48d8ff9640 10 client.30818.objecter ms_handle_connect 0x7f48ac0a49a0 2026-02-25T15:07:29.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.648+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== osd.8 v1:10.20.193.21:6800/3085828309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f48ac0c6600 con 0x7f48ac0a49a0 2026-02-25T15:07:29.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.648+0000 7f48d8ff9640 10 client.30818.objecter ms_dispatch2 0x7f48dc000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:29.650 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.648+0000 7f48d8ff9640 10 client.30818.objecter _finish_command 1 = system:0 2026-02-25T15:07:29.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.648+0000 7f48d8ff9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 4 2026-02-25T15:07:29.651 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.648+0000 7f48d8ff9640 15 client.30818.objecter _session_command_op_remove 8 1 2026-02-25T15:07:29.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 10 client.30818.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:29.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 15 client.30818.objecter _session_command_op_assign -1 2 2026-02-25T15:07:29.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 20 client.30818.objecter _get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 20 client.30818.objecter _get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 15 client.30818.objecter _session_command_op_remove -1 2 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 20 client.30818.objecter get_session s=0x7f48ac0a42f0 osd=8 3 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 15 client.30818.objecter _session_command_op_assign 8 2 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 4 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 10 client.30818.objecter _send_command 2 2026-02-25T15:07:29.657 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.654+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 --> v1:10.20.193.21:6800/3085828309 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f48dc15c670 con 0x7f48ac0a49a0 2026-02-25T15:07:29.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48d8ff9640 1 -- 10.20.193.21:0/2656576638 <== osd.8 v1:10.20.193.21:6800/3085828309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f48dc15c670 con 0x7f48ac0a49a0 2026-02-25T15:07:29.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48d8ff9640 10 client.30818.objecter ms_dispatch2 0x7f48dc000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48d8ff9640 10 client.30818.objecter _finish_command 2 = system:0 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48d8ff9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 4 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48d8ff9640 15 client.30818.objecter _session_command_op_remove 8 2 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:29.664 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 10 librados: watch_flush enter 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 10 librados: watch_flush exit 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 10 client.30818.objecter close_session for osd.8 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 >> v1:10.20.193.21:6800/3085828309 conn(0x7f48ac0a49a0 legacy=0x7f48ac0c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 20 client.30818.objecter put_session s=0x7f48ac0a42f0 osd=8 1 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 20 client.30818.objecter shutdown clearing up homeless session... 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 10 client.30818.objecter successfully canceled tick 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 >> v1:10.20.193.72:6800/2463505645 conn(0x7f48ac07a040 legacy=0x7f48ac09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.666 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 10 monclient: shutdown 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 >> v1:10.20.193.68:6789/0 conn(0x7f48dc059e10 legacy=0x7f48dc1207d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e0c2f640 1 -- 10.20.193.21:0/2656576638 reap_dead start 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 shutdown_connections 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 >> 10.20.193.21:0/2656576638 conn(0x7f48dc0b2f60 msgr2=0x7f48dc15ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 shutdown_connections 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 -- 10.20.193.21:0/2656576638 wait complete. 2026-02-25T15:07:29.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.662+0000 7f48e26b9640 1 librados: shutdown 2026-02-25T15:07:29.672 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 10 monclient: get_monmap_and_config 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 10 monclient: monmap: 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:29.738010+0000 2026-02-25T15:07:29.739 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:29.738010+0000 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.740 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 1 Processor -- start 2026-02-25T15:07:29.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 1 -- start start 2026-02-25T15:07:29.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.737+0000 7fe0386fe640 10 monclient: init 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-b con 0x7fe030157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe030157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-c con 0x7fe030164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03005de70 con 0x7fe030157b50 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe030055b20 con 0x7fe030157780 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe030055e00 con 0x7fe030164d00 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe0386fe640 10 monclient(hunting): authenticate will time out at 3393.330374s 2026-02-25T15:07:29.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe035c72640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe030157b50 0x7fe0301645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43236/0 (socket says 10.20.193.21:43236) 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.738+0000 7fe035c72640 1 -- 10.20.193.21:0/2832713744 learned_addr learned my addr 10.20.193.21:0/2832713744 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190095540 0 0) 0x7fe03005de70 con 0x7fe030157b50 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 10 monclient(hunting): my global_id is 28194 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.739+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe018003610 con 0x7fe030157b50 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028011746 0 0) 0x7fe030055e00 con 0x7fe030164d00 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): my global_id is 30821 2026-02-25T15:07:29.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe03005de70 con 0x7fe030164d00 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051095821 0 0) 0x7fe030055b20 con 0x7fe030157780 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 10 monclient(hunting): my global_id is 29167 2026-02-25T15:07:29.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.740+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030055e00 con 0x7fe030157780 2026-02-25T15:07:29.752 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106670178 0 0) 0x7fe018003610 con 0x7fe030157b50 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 >> v1:10.20.193.68:6789/0 conn(0x7fe030164d00 legacy=0x7fe0301c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 >> v1:10.20.193.31:6789/0 conn(0x7fe030157780 legacy=0x7fe030056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 monclient: found mon.noname-a 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0300560e0 con 0x7fe030157b50 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe024002df0 con 0x7fe030157b50 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe035471640 10 monclient: dump: 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.754 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe0386fe640 5 monclient: authenticate success, global_id 28194 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.741+0000 7fe0386fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe024002fc0 con 0x7fe030157b50 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 1 -- 10.20.193.21:0/2832713744 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe024003400 con 0x7fe030157b50 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe035471640 10 monclient: dump: 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.755 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 4 set_mon_vals no callback set 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 10 monclient: shutdown 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.756 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 1 -- 10.20.193.21:0/2832713744 >> v1:10.20.193.21:6789/0 conn(0x7fe030157b50 legacy=0x7fe0301645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 1 -- 10.20.193.21:0/2832713744 shutdown_connections 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 1 -- 10.20.193.21:0/2832713744 >> 10.20.193.21:0/2832713744 conn(0x7fe0300b2ef0 msgr2=0x7fe0300b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 1 -- 10.20.193.21:0/2832713744 shutdown_connections 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.742+0000 7fe0386fe640 1 -- 10.20.193.21:0/2832713744 wait complete. 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 10 monclient: build_initial_monmap 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 10 monclient: monmap: 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:29.757 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 librados: starting msgr at 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 librados: starting objecter 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 Processor -- start 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 -- start start 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 librados: setting wanted keys 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 1 librados: calling monclient init 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.743+0000 7fe0386fe640 10 monclient: init 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:29.758 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-c con 0x7fe030157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe030157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient(hunting): picked mon.noname-b con 0x7fe030164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe030139f10 con 0x7fe030157b50 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0300aff80 con 0x7fe030164d00 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe030139c30 con 0x7fe030157780 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe0386fe640 10 monclient(hunting): authenticate will time out at 3393.336211s 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe035c72640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fe030157b50 0x7fe030136890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43244/0 (socket says 10.20.193.21:43244) 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe035c72640 1 -- 10.20.193.21:0/4149328427 learned_addr learned my addr 10.20.193.21:0/4149328427 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe016ffd640 10 client.?.objecter ms_handle_connect 0x7fe030157b50 2026-02-25T15:07:29.759 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe016ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe016ffd640 10 client.?.objecter ms_handle_connect 0x7fe030157780 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.744+0000 7fe016ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 client.?.objecter ms_handle_connect 0x7fe030164d00 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3427878217 0 0) 0x7fe030139f10 con 0x7fe030157b50 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): my global_id is 28197 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe000003610 con 0x7fe030157b50 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018724397 0 0) 0x7fe030139c30 con 0x7fe030157780 2026-02-25T15:07:29.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 10 monclient(hunting): my global_id is 30824 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.745+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030139f10 con 0x7fe030157780 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052401504 0 0) 0x7fe0300aff80 con 0x7fe030164d00 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 10 monclient(hunting): my global_id is 29170 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.746+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030139c30 con 0x7fe030164d00 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1920270624 0 0) 0x7fe030139f10 con 0x7fe030157780 2026-02-25T15:07:29.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0300aff80 con 0x7fe030157780 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe020003060 con 0x7fe030157780 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.762 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3462092277 0 0) 0x7fe000003610 con 0x7fe030157b50 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe030139f10 con 0x7fe030157b50 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe024003310 con 0x7fe030157b50 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.763 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3272101684 0 0) 0x7fe030139c30 con 0x7fe030164d00 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe000003610 con 0x7fe030164d00 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe02c003370 con 0x7fe030164d00 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.748+0000 7fe016ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:29.764 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3913734962 0 0) 0x7fe0300aff80 con 0x7fe030157780 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 >> v1:10.20.193.31:6789/0 conn(0x7fe030164d00 legacy=0x7fe030138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 >> v1:10.20.193.21:6789/0 conn(0x7fe030157b50 legacy=0x7fe030136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 1 monclient: found mon.c 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030135ad0 con 0x7fe030157780 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe016ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 5 monclient: authenticate success, global_id 30824 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 10 monclient: _renew_subs 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe030135db0 con 0x7fe030157780 2026-02-25T15:07:29.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 10 client.30824.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 10 monclient: _renew_subs 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe030136370 con 0x7fe030157780 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.749+0000 7fe0386fe640 1 librados: init done 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.750+0000 7fe0386fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.750+0000 7fe0386fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.750+0000 7fe0386fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:29.767 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.750+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03015ea20 con 0x7fe030157780 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe020003200 con 0x7fe030157780 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fe020003920 con 0x7fe030157780 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe034c70640 4 set_mon_vals no callback set 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 10 monclient: dump: 2026-02-25T15:07:29.846 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:29.847 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:29.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.844+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fe02001ce00 con 0x7fe030157780 2026-02-25T15:07:29.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.845+0000 7fe035c72640 10 monclient: get_auth_request con 0x7fe00007a040 auth_method 0 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.845+0000 7fe016ffd640 10 client.30824.objecter ms_handle_connect 0x7fe00007a040 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.846+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fe0200948b0 con 0x7fe030157780 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.846+0000 7fe016ffd640 10 client.30824.objecter ms_dispatch2 0x7fe030000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.846+0000 7fe016ffd640 3 client.30824.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.846+0000 7fe016ffd640 3 client.30824.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.846+0000 7fe016ffd640 20 client.30824.objecter dump_active .. 0 homeless 2026-02-25T15:07:29.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.847+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fe02005e210 con 0x7fe030157780 2026-02-25T15:07:29.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.847+0000 7fe016ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:29.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.847+0000 7fe016ffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:29.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.951+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7fe0300b5160 con 0x7fe00007a040 2026-02-25T15:07:29.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.951+0000 7fe016ffd640 1 -- 10.20.193.21:0/4149328427 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7fe0300b5160 con 0x7fe00007a040 2026-02-25T15:07:29.953 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 8 to deep-scrub 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 10 librados: watch_flush enter 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 10 librados: watch_flush exit 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 20 client.30824.objecter shutdown clearing up homeless session... 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 10 client.30824.objecter successfully canceled tick 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 >> v1:10.20.193.72:6800/2463505645 conn(0x7fe00007a040 legacy=0x7fe00009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 10 monclient: shutdown 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 >> v1:10.20.193.68:6789/0 conn(0x7fe030157780 legacy=0x7fe0300af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 shutdown_connections 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 >> 10.20.193.21:0/4149328427 conn(0x7fe0300b2ef0 msgr2=0x7fe0300b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:29.955 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 shutdown_connections 2026-02-25T15:07:29.956 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 -- 10.20.193.21:0/4149328427 wait complete. 2026-02-25T15:07:29.956 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:29.952+0000 7fe0386fe640 1 librados: shutdown 2026-02-25T15:07:29.962 INFO:tasks.ceph:Scrubbing osd.12 2026-02-25T15:07:29.962 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 10 monclient: get_monmap_and_config 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 10 monclient: monmap: 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.031015+0000 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.031015+0000 2026-02-25T15:07:30.032 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.033 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.033 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.033 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.033 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.033 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 1 Processor -- start 2026-02-25T15:07:30.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 1 -- start start 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.030+0000 7f45a804d640 10 monclient: init 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-a con 0x7f45a015e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-c con 0x7f45a0059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-b con 0x7f45a01a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a0162df0 con 0x7f45a015e2a0 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a01630d0 con 0x7f45a01a5660 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a01633b0 con 0x7f45a0059e10 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a804d640 10 monclient(hunting): authenticate will time out at 3393.623459s 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a5dc2640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f45a015e2a0 0x7f45a005da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43254/0 (socket says 10.20.193.21:43254) 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.031+0000 7f45a5dc2640 1 -- 10.20.193.21:0/3395701496 learned_addr learned my addr 10.20.193.21:0/3395701496 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813818877 0 0) 0x7f45a01630d0 con 0x7f45a01a5660 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): my global_id is 29173 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4588003610 con 0x7f45a01a5660 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130427524 0 0) 0x7f45a01633b0 con 0x7f45a0059e10 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): my global_id is 30827 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a01630d0 con 0x7f45a0059e10 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376929443 0 0) 0x7f45a0162df0 con 0x7f45a015e2a0 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 10 monclient(hunting): my global_id is 28200 2026-02-25T15:07:30.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.033+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a01633b0 con 0x7f45a015e2a0 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3906058739 0 0) 0x7f4588003610 con 0x7f45a01a5660 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 >> v1:10.20.193.68:6789/0 conn(0x7f45a0059e10 legacy=0x7f45a015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 >> v1:10.20.193.21:6789/0 conn(0x7f45a015e2a0 legacy=0x7f45a005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 monclient: found mon.noname-b 2026-02-25T15:07:30.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0163690 con 0x7f45a01a5660 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f459c003170 con 0x7f45a01a5660 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a4dc0640 10 monclient: dump: 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.047 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a804d640 5 monclient: authenticate success, global_id 29173 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.034+0000 7f45a804d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f459c003340 con 0x7f45a01a5660 2026-02-25T15:07:30.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 1 -- 10.20.193.21:0/3395701496 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f459c003780 con 0x7f45a01a5660 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a804d640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a804d640 4 set_mon_vals no callback set 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.035+0000 7f45a4dc0640 10 monclient: dump: 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.049 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 10 monclient: shutdown 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- 10.20.193.21:0/3395701496 >> v1:10.20.193.31:6789/0 conn(0x7f45a01a5660 legacy=0x7f45a01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- 10.20.193.21:0/3395701496 shutdown_connections 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- 10.20.193.21:0/3395701496 >> 10.20.193.21:0/3395701496 conn(0x7f45a00b2f60 msgr2=0x7f45a00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- 10.20.193.21:0/3395701496 shutdown_connections 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- 10.20.193.21:0/3395701496 wait complete. 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 10 monclient: monmap: 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.051 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 librados: starting msgr at 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 librados: starting objecter 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 Processor -- start 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 -- start start 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 librados: setting wanted keys 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 1 librados: calling monclient init 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.036+0000 7f45a804d640 10 monclient: init 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:30.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-c con 0x7f45a0059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-b con 0x7f45a015e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient(hunting): picked mon.noname-a con 0x7f45a01a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a005d230 con 0x7f45a01a5660 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a005d510 con 0x7f45a015e2a0 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a005d7f0 con 0x7f45a0059e10 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a804d640 10 monclient(hunting): authenticate will time out at 3393.629363s 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a65c3640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f45a01a5660 0x7f45a00af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43266/0 (socket says 10.20.193.21:43266) 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f45a65c3640 1 -- 10.20.193.21:0/1875936872 learned_addr learned my addr 10.20.193.21:0/1875936872 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f458e7fc640 10 client.?.objecter ms_handle_connect 0x7f45a01a5660 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f458e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.053 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f458e7fc640 10 client.?.objecter ms_handle_connect 0x7f45a015e2a0 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.037+0000 7f458e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 client.?.objecter ms_handle_connect 0x7f45a0059e10 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950232834 0 0) 0x7f45a005d510 con 0x7f45a015e2a0 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): my global_id is 29176 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4570003610 con 0x7f45a015e2a0 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807007594 0 0) 0x7f45a005d230 con 0x7f45a01a5660 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.054 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 10 monclient(hunting): my global_id is 28203 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.038+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a005d510 con 0x7f45a01a5660 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067937804 0 0) 0x7f45a005d7f0 con 0x7f45a0059e10 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 10 monclient(hunting): my global_id is 30830 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.039+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a005d230 con 0x7f45a0059e10 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3511494840 0 0) 0x7f4570003610 con 0x7f45a015e2a0 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45a005d7f0 con 0x7f45a015e2a0 2026-02-25T15:07:30.055 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4594002ff0 con 0x7f45a015e2a0 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.056 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3701885047 0 0) 0x7f45a005d230 con 0x7f45a0059e10 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4570003610 con 0x7f45a0059e10 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4590003060 con 0x7f45a0059e10 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.057 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2113949798 0 0) 0x7f45a005d510 con 0x7f45a01a5660 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45a005d230 con 0x7f45a01a5660 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f459c003690 con 0x7f45a01a5660 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:30.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.041+0000 7f458e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4056410676 0 0) 0x7f45a005d7f0 con 0x7f45a015e2a0 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 >> v1:10.20.193.68:6789/0 conn(0x7f45a0059e10 legacy=0x7f45a01a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 >> v1:10.20.193.21:6789/0 conn(0x7f45a01a5660 legacy=0x7f45a00af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 1 monclient: found mon.b 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a00a78e0 con 0x7f45a015e2a0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f458e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 5 monclient: authenticate success, global_id 29176 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 monclient: _renew_subs 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45a00a7bc0 con 0x7f45a015e2a0 2026-02-25T15:07:30.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 client.29176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 monclient: _renew_subs 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f45a00a8ad0 con 0x7f45a015e2a0 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 1 librados: init done 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 client.29176.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 15 client.29176.objecter _session_command_op_assign -1 1 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 20 client.29176.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 client.29176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.061 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.043+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f45a00a8d60 con 0x7f45a015e2a0 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45a00a8d60 con 0x7f45a015e2a0 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f45940037b0 con 0x7f45a015e2a0 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458ffff640 4 set_mon_vals no callback set 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.051+0000 7f458e7fc640 10 monclient: dump: 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.064 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.052+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f459401cc90 con 0x7f45a015e2a0 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.052+0000 7f45a5dc2640 10 monclient: get_auth_request con 0x7f4570079ff0 auth_method 0 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 10 client.29176.objecter ms_handle_connect 0x7f4570079ff0 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f4594094650 con 0x7f45a015e2a0 2026-02-25T15:07:30.065 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 10 client.29176.objecter ms_dispatch2 0x7f45a0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 3 client.29176.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 3 client.29176.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 10 client.29176.objecter checking command 1 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter _get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 15 client.29176.objecter _session_command_op_remove -1 1 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter _get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 15 client.29176.objecter _session_command_op_assign 12 1 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 4 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 10 client.29176.objecter _send_command 1 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.21:6808/3798667347 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45700c65b0 con 0x7f45700a4950 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 20 client.29176.objecter dump_active .. 0 homeless 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f459405d680 con 0x7f45a015e2a0 2026-02-25T15:07:30.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.053+0000 7f458e7fc640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.054+0000 7f45a65c3640 10 monclient: get_auth_request con 0x7f45700a4950 auth_method 0 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.055+0000 7f458e7fc640 10 client.29176.objecter ms_handle_connect 0x7f45700a4950 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.064+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== osd.12 v1:10.20.193.21:6808/3798667347 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f45700c65b0 con 0x7f45700a4950 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.064+0000 7f458e7fc640 10 client.29176.objecter ms_dispatch2 0x7f45a0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.064+0000 7f458e7fc640 10 client.29176.objecter _finish_command 1 = system:0 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.064+0000 7f458e7fc640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 4 2026-02-25T15:07:30.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.064+0000 7f458e7fc640 15 client.29176.objecter _session_command_op_remove 12 1 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 10 client.29176.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 15 client.29176.objecter _session_command_op_assign -1 2 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 20 client.29176.objecter _get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 20 client.29176.objecter _get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 15 client.29176.objecter _session_command_op_remove -1 2 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 20 client.29176.objecter get_session s=0x7f45700a42a0 osd=12 3 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 15 client.29176.objecter _session_command_op_assign 12 2 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 4 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 10 client.29176.objecter _send_command 2 2026-02-25T15:07:30.073 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.071+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 --> v1:10.20.193.21:6808/3798667347 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f45a015c7c0 con 0x7f45700a4950 2026-02-25T15:07:30.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f458e7fc640 1 -- 10.20.193.21:0/1875936872 <== osd.12 v1:10.20.193.21:6808/3798667347 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f45a015c7c0 con 0x7f45700a4950 2026-02-25T15:07:30.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f458e7fc640 10 client.29176.objecter ms_dispatch2 0x7f45a0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f458e7fc640 10 client.29176.objecter _finish_command 2 = system:0 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f458e7fc640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 4 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f458e7fc640 15 client.29176.objecter _session_command_op_remove 12 2 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:30.081 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.078+0000 7f45a804d640 10 librados: watch_flush enter 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 10 librados: watch_flush exit 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 10 client.29176.objecter close_session for osd.12 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 >> v1:10.20.193.21:6808/3798667347 conn(0x7f45700a4950 legacy=0x7f45700c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 20 client.29176.objecter put_session s=0x7f45700a42a0 osd=12 1 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 20 client.29176.objecter shutdown clearing up homeless session... 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 10 client.29176.objecter successfully canceled tick 2026-02-25T15:07:30.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 >> v1:10.20.193.72:6800/2463505645 conn(0x7f4570079ff0 legacy=0x7f457009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 10 monclient: shutdown 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 >> v1:10.20.193.31:6789/0 conn(0x7f45a015e2a0 legacy=0x7f45a00a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a65c3640 1 -- 10.20.193.21:0/1875936872 reap_dead start 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 shutdown_connections 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 >> 10.20.193.21:0/1875936872 conn(0x7f45a00b2f60 msgr2=0x7f45a0164170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 shutdown_connections 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 -- 10.20.193.21:0/1875936872 wait complete. 2026-02-25T15:07:30.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.079+0000 7f45a804d640 1 librados: shutdown 2026-02-25T15:07:30.089 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-25T15:07:30.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.156+0000 7f63579a2640 10 monclient: get_monmap_and_config 2026-02-25T15:07:30.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.156+0000 7f63579a2640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.156+0000 7f63579a2640 10 monclient: monmap: 2026-02-25T15:07:30.158 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.158 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.157292+0000 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.157292+0000 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.159 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 1 Processor -- start 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 1 -- start start 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient: init 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-c con 0x7f6350157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-b con 0x7f6350157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-a con 0x7f6350164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635005de70 con 0x7f6350164d00 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6350055b20 con 0x7f6350157b50 2026-02-25T15:07:30.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6350055e00 con 0x7f6350157780 2026-02-25T15:07:30.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.157+0000 7f63579a2640 10 monclient(hunting): authenticate will time out at 3393.749622s 2026-02-25T15:07:30.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.158+0000 7f6355f18640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f6350164d00 0x7f63501c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43274/0 (socket says 10.20.193.21:43274) 2026-02-25T15:07:30.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.158+0000 7f6355f18640 1 -- 10.20.193.21:0/544912993 learned_addr learned my addr 10.20.193.21:0/544912993 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059392693 0 0) 0x7f6350055e00 con 0x7f6350157780 2026-02-25T15:07:30.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 10 monclient(hunting): my global_id is 30833 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.159+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6338003610 con 0x7f6350157780 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421090701 0 0) 0x7f6350055b20 con 0x7f6350157b50 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): my global_id is 29179 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6350055e00 con 0x7f6350157b50 2026-02-25T15:07:30.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130205658 0 0) 0x7f635005de70 con 0x7f6350164d00 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 10 monclient(hunting): my global_id is 28206 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.160+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6350055b20 con 0x7f6350164d00 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1417286 0 0) 0x7f6338003610 con 0x7f6350157780 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 >> v1:10.20.193.31:6789/0 conn(0x7f6350157b50 legacy=0x7f63501645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 >> v1:10.20.193.21:6789/0 conn(0x7f6350164d00 legacy=0x7f63501c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 monclient: found mon.noname-c 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:30.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63500560e0 con 0x7f6350157780 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6340002df0 con 0x7f6350157780 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f633ffff640 10 monclient: dump: 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.170 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f63579a2640 5 monclient: authenticate success, global_id 30833 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.161+0000 7f63579a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6340002fc0 con 0x7f6350157780 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 1 -- 10.20.193.21:0/544912993 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6340003400 con 0x7f6350157780 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.171 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f633ffff640 10 monclient: dump: 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.172 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 4 set_mon_vals no callback set 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 10 monclient: shutdown 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 1 -- 10.20.193.21:0/544912993 >> v1:10.20.193.68:6789/0 conn(0x7f6350157780 legacy=0x7f6350056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 1 -- 10.20.193.21:0/544912993 shutdown_connections 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 1 -- 10.20.193.21:0/544912993 >> 10.20.193.21:0/544912993 conn(0x7f63500b2ef0 msgr2=0x7f63500b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 1 -- 10.20.193.21:0/544912993 shutdown_connections 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 1 -- 10.20.193.21:0/544912993 wait complete. 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.162+0000 7f63579a2640 10 monclient: monmap: 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.173 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 librados: starting msgr at 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 librados: starting objecter 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 Processor -- start 2026-02-25T15:07:30.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 -- start start 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 librados: setting wanted keys 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 librados: calling monclient init 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient: init 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-b con 0x7f6350157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-c con 0x7f6350157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient(hunting): picked mon.noname-a con 0x7f6350164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635012f960 con 0x7f6350164d00 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63500a5720 con 0x7f6350157780 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63500a5a00 con 0x7f6350157b50 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f63579a2640 10 monclient(hunting): authenticate will time out at 3393.755590s 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f6354f16640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f6350157b50 0x7f6350160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:47868/0 (socket says 10.20.193.21:47868) 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.163+0000 7f6354f16640 1 -- 10.20.193.21:0/2957533648 learned_addr learned my addr 10.20.193.21:0/2957533648 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter ms_handle_connect 0x7f6350157b50 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter ms_handle_connect 0x7f6350157780 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter ms_handle_connect 0x7f6350164d00 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498365992 0 0) 0x7f63500a5a00 con 0x7f6350157b50 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.164+0000 7f633dffb640 10 monclient(hunting): my global_id is 30836 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6320003610 con 0x7f6350157b50 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883274353 0 0) 0x7f63500a5720 con 0x7f6350157780 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): my global_id is 29182 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63500a5a00 con 0x7f6350157780 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164189395 0 0) 0x7f635012f960 con 0x7f6350164d00 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 10 monclient(hunting): my global_id is 28209 2026-02-25T15:07:30.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.165+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63500a5720 con 0x7f6350164d00 2026-02-25T15:07:30.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1591488731 0 0) 0x7f63500a5a00 con 0x7f6350157780 2026-02-25T15:07:30.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f635012f960 con 0x7f6350157780 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6340003310 con 0x7f6350157780 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.182 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3694737030 0 0) 0x7f6320003610 con 0x7f6350157b50 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63500a5a00 con 0x7f6350157b50 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6344003190 con 0x7f6350157b50 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.167+0000 7f633dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.183 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 776330158 0 0) 0x7f63500a5720 con 0x7f6350164d00 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6320003610 con 0x7f6350164d00 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f634c003330 con 0x7f6350164d00 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.168+0000 7f633dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2323994463 0 0) 0x7f635012f960 con 0x7f6350157780 2026-02-25T15:07:30.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 >> v1:10.20.193.68:6789/0 conn(0x7f6350157b50 legacy=0x7f6350160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 >> v1:10.20.193.21:6789/0 conn(0x7f6350164d00 legacy=0x7f635009ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 1 monclient: found mon.b 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63500a5ce0 con 0x7f6350157780 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f633dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 5 monclient: authenticate success, global_id 29182 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _renew_subs 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63500a5fc0 con 0x7f6350157780 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 client.29182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _renew_subs 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63501453b0 con 0x7f6350157780 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 1 librados: init done 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.169+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6350145640 con 0x7f6350157780 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6340002f80 con 0x7f6350157780 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6340003960 con 0x7f6350157780 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633f7fe640 4 set_mon_vals no callback set 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.174+0000 7f633dffb640 10 monclient: dump: 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.177+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f634001cca0 con 0x7f6350157780 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.178+0000 7f6354f16640 10 monclient: get_auth_request con 0x7f632007a0c0 auth_method 0 2026-02-25T15:07:30.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.178+0000 7f633dffb640 10 client.29182.objecter ms_handle_connect 0x7f632007a0c0 2026-02-25T15:07:30.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.179+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f63400947b0 con 0x7f6350157780 2026-02-25T15:07:30.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.179+0000 7f633dffb640 10 client.29182.objecter ms_dispatch2 0x7f6350000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:30.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.179+0000 7f633dffb640 3 client.29182.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:30.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.179+0000 7f633dffb640 3 client.29182.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:30.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.179+0000 7f633dffb640 20 client.29182.objecter dump_active .. 0 homeless 2026-02-25T15:07:30.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.267+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f634005e110 con 0x7f6350157780 2026-02-25T15:07:30.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.267+0000 7f633dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.267+0000 7f633dffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:30.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.372+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f63501448c0 con 0x7f632007a0c0 2026-02-25T15:07:30.374 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.372+0000 7f633dffb640 1 -- 10.20.193.21:0/2957533648 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7f63501448c0 con 0x7f632007a0c0 2026-02-25T15:07:30.374 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 12 to deep-scrub 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 10 librados: watch_flush enter 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 10 librados: watch_flush exit 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 20 client.29182.objecter shutdown clearing up homeless session... 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 10 client.29182.objecter successfully canceled tick 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 >> v1:10.20.193.72:6800/2463505645 conn(0x7f632007a0c0 legacy=0x7f632009a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 10 monclient: shutdown 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 >> v1:10.20.193.31:6789/0 conn(0x7f6350157780 legacy=0x7f6350144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 shutdown_connections 2026-02-25T15:07:30.376 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 >> 10.20.193.21:0/2957533648 conn(0x7f63500b2ef0 msgr2=0x7f6350131680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 shutdown_connections 2026-02-25T15:07:30.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 -- 10.20.193.21:0/2957533648 wait complete. 2026-02-25T15:07:30.377 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.373+0000 7f63579a2640 1 librados: shutdown 2026-02-25T15:07:30.384 INFO:tasks.ceph:Scrubbing osd.1 2026-02-25T15:07:30.385 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 10 monclient: get_monmap_and_config 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 10 monclient: monmap: 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.452023+0000 2026-02-25T15:07:30.453 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.452023+0000 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.454 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 1 Processor -- start 2026-02-25T15:07:30.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 1 -- start start 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.451+0000 7f5272e01640 10 monclient: init 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-b con 0x7f526c0b9f80 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-c con 0x7f526c0ba350 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-a con 0x7f526c0585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c163930 con 0x7f526c0585e0 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c163bb0 con 0x7f526c0b9f80 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c163e90 con 0x7f526c0ba350 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5272e01640 10 monclient(hunting): authenticate will time out at 3394.044522s 2026-02-25T15:07:30.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5271377640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f526c0585e0 0x7f526c166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43286/0 (socket says 10.20.193.21:43286) 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.452+0000 7f5271377640 1 -- 10.20.193.21:0/1100150184 learned_addr learned my addr 10.20.193.21:0/1100150184 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642545378 0 0) 0x7f526c163e90 con 0x7f526c0ba350 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): my global_id is 30839 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5258003610 con 0x7f526c0ba350 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687071738 0 0) 0x7f5268002c90 con 0x7f526c0585e0 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.458 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 10 monclient(hunting): my global_id is 28212 2026-02-25T15:07:30.459 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.454+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f526c163e90 con 0x7f526c0585e0 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538352873 0 0) 0x7f526c163bb0 con 0x7f526c0b9f80 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 10 monclient(hunting): my global_id is 29185 2026-02-25T15:07:30.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.455+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5268002c90 con 0x7f526c0b9f80 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084471510 0 0) 0x7f5258003610 con 0x7f526c0ba350 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 >> v1:10.20.193.31:6789/0 conn(0x7f526c0b9f80 legacy=0x7f526c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 >> v1:10.20.193.21:6789/0 conn(0x7f526c0585e0 legacy=0x7f526c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 monclient: found mon.noname-c 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c0573f0 con 0x7f526c0ba350 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5254002df0 con 0x7f526c0ba350 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f52637fe640 10 monclient: dump: 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.465 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f5272e01640 5 monclient: authenticate success, global_id 30839 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.456+0000 7f5272e01640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5254002fc0 con 0x7f526c0ba350 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 1 -- 10.20.193.21:0/1100150184 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5254003400 con 0x7f526c0ba350 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f5272e01640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f5272e01640 4 set_mon_vals no callback set 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.457+0000 7f52637fe640 10 monclient: dump: 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.467 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 10 monclient: shutdown 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- 10.20.193.21:0/1100150184 >> v1:10.20.193.68:6789/0 conn(0x7f526c0ba350 legacy=0x7f526c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- 10.20.193.21:0/1100150184 shutdown_connections 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- 10.20.193.21:0/1100150184 >> 10.20.193.21:0/1100150184 conn(0x7f526c0b7990 msgr2=0x7f526c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- 10.20.193.21:0/1100150184 shutdown_connections 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- 10.20.193.21:0/1100150184 wait complete. 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 10 monclient: monmap: 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:30.468 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 librados: starting msgr at 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 librados: starting objecter 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 Processor -- start 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 -- start start 2026-02-25T15:07:30.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 librados: setting wanted keys 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 1 librados: calling monclient init 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.458+0000 7f5272e01640 10 monclient: init 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-b con 0x7f526c0585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-c con 0x7f526c0b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient(hunting): picked mon.noname-a con 0x7f526c0ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c156c80 con 0x7f526c0ba350 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c1fb4b0 con 0x7f526c0585e0 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f526c1fb790 con 0x7f526c0b9f80 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5272e01640 10 monclient(hunting): authenticate will time out at 3394.051202s 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5270b76640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f526c0585e0 0x7f526c156570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48498/0 (socket says 10.20.193.21:48498) 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f5270b76640 1 -- 10.20.193.21:0/3276956268 learned_addr learned my addr 10.20.193.21:0/3276956268 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter ms_handle_connect 0x7f526c0585e0 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter ms_handle_connect 0x7f526c0ba350 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter ms_handle_connect 0x7f526c0b9f80 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.459+0000 7f52617fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191217092 0 0) 0x7f526c1fb4b0 con 0x7f526c0585e0 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): my global_id is 29188 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f523c003610 con 0x7f526c0585e0 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382807964 0 0) 0x7f526c1fb790 con 0x7f526c0b9f80 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 10 monclient(hunting): my global_id is 30842 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.460+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f526c1fb4b0 con 0x7f526c0b9f80 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919500976 0 0) 0x7f526c156c80 con 0x7f526c0ba350 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 10 monclient(hunting): my global_id is 28215 2026-02-25T15:07:30.473 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.461+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f526c1fb790 con 0x7f526c0ba350 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1578620403 0 0) 0x7f523c003610 con 0x7f526c0585e0 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f526c156c80 con 0x7f526c0585e0 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f525c003210 con 0x7f526c0585e0 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.477 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.462+0000 7f52617fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 146062540 0 0) 0x7f526c1fb4b0 con 0x7f526c0b9f80 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f523c003610 con 0x7f526c0b9f80 2026-02-25T15:07:30.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5254003310 con 0x7f526c0b9f80 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.479 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 43287037 0 0) 0x7f526c1fb790 con 0x7f526c0ba350 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f526c1fb4b0 con 0x7f526c0ba350 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f52680035c0 con 0x7f526c0ba350 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.463+0000 7f52617fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.480 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 523954469 0 0) 0x7f526c156c80 con 0x7f526c0585e0 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 >> v1:10.20.193.68:6789/0 conn(0x7f526c0b9f80 legacy=0x7f526c0b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 >> v1:10.20.193.21:6789/0 conn(0x7f526c0ba350 legacy=0x7f526c158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 1 monclient: found mon.b 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c1fba70 con 0x7f526c0585e0 2026-02-25T15:07:30.481 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f52617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 5 monclient: authenticate success, global_id 29188 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 10 monclient: _renew_subs 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f526c1fbd50 con 0x7f526c0585e0 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 10 client.29188.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 10 monclient: _renew_subs 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f526c1fb130 con 0x7f526c0585e0 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.464+0000 7f5272e01640 1 librados: init done 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 10 client.29188.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.482 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 15 client.29188.objecter _session_command_op_assign -1 1 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 20 client.29188.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 10 client.29188.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.465+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f526c1fbf90 con 0x7f526c0585e0 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f526c1fbf90 con 0x7f526c0585e0 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f525c003b50 con 0x7f526c0585e0 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f52617fa640 10 monclient: dump: 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.483 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.470+0000 7f5262ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.473+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f525c003b50 con 0x7f526c0585e0 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f5263fff640 10 monclient: get_auth_request con 0x7f523c07a120 auth_method 0 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 10 client.29188.objecter ms_handle_connect 0x7f523c07a120 2026-02-25T15:07:30.484 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f525c095a30 con 0x7f526c0585e0 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 10 client.29188.objecter ms_dispatch2 0x7f526c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 3 client.29188.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 3 client.29188.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 10 client.29188.objecter checking command 1 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter _get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 15 client.29188.objecter _session_command_op_remove -1 1 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter _get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 15 client.29188.objecter _session_command_op_assign 1 1 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 4 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 10 client.29188.objecter _send_command 1 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6808/1809978267 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f525c0033b0 con 0x7f523c0a4a80 2026-02-25T15:07:30.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f52617fa640 20 client.29188.objecter dump_active .. 0 homeless 2026-02-25T15:07:30.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.474+0000 7f5271377640 10 monclient: get_auth_request con 0x7f523c0a4a80 auth_method 0 2026-02-25T15:07:30.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.475+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f525c05b000 con 0x7f526c0585e0 2026-02-25T15:07:30.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.475+0000 7f52617fa640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:30.486 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.475+0000 7f52617fa640 10 client.29188.objecter ms_handle_connect 0x7f523c0a4a80 2026-02-25T15:07:30.487 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.486+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== osd.1 v1:10.20.193.31:6808/1809978267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f525c0033b0 con 0x7f523c0a4a80 2026-02-25T15:07:30.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.486+0000 7f52617fa640 10 client.29188.objecter ms_dispatch2 0x7f526c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:30.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.486+0000 7f52617fa640 10 client.29188.objecter _finish_command 1 = system:0 2026-02-25T15:07:30.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.486+0000 7f52617fa640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 4 2026-02-25T15:07:30.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.486+0000 7f52617fa640 15 client.29188.objecter _session_command_op_remove 1 1 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 10 client.29188.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 15 client.29188.objecter _session_command_op_assign -1 2 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 20 client.29188.objecter _get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 20 client.29188.objecter _get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 15 client.29188.objecter _session_command_op_remove -1 2 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 20 client.29188.objecter get_session s=0x7f523c0a43d0 osd=1 3 2026-02-25T15:07:30.495 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 15 client.29188.objecter _session_command_op_assign 1 2 2026-02-25T15:07:30.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 4 2026-02-25T15:07:30.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 10 client.29188.objecter _send_command 2 2026-02-25T15:07:30.496 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.493+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 --> v1:10.20.193.31:6808/1809978267 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f526c159260 con 0x7f523c0a4a80 2026-02-25T15:07:30.503 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.501+0000 7f52617fa640 1 -- 10.20.193.21:0/3276956268 <== osd.1 v1:10.20.193.31:6808/1809978267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f526c159260 con 0x7f523c0a4a80 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f52617fa640 10 client.29188.objecter ms_dispatch2 0x7f526c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f52617fa640 10 client.29188.objecter _finish_command 2 = system:0 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f52617fa640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 4 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f52617fa640 15 client.29188.objecter _session_command_op_remove 1 2 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:30.504 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:30.506 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 10 librados: watch_flush enter 2026-02-25T15:07:30.506 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 10 librados: watch_flush exit 2026-02-25T15:07:30.506 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 10 client.29188.objecter close_session for osd.1 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 >> v1:10.20.193.31:6808/1809978267 conn(0x7f523c0a4a80 legacy=0x7f523c0c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 20 client.29188.objecter put_session s=0x7f523c0a43d0 osd=1 1 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 20 client.29188.objecter shutdown clearing up homeless session... 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 10 client.29188.objecter successfully canceled tick 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 >> v1:10.20.193.72:6800/2463505645 conn(0x7f523c07a120 legacy=0x7f523c09a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 10 monclient: shutdown 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 >> v1:10.20.193.31:6789/0 conn(0x7f526c0585e0 legacy=0x7f526c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5271377640 1 -- 10.20.193.21:0/3276956268 reap_dead start 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 shutdown_connections 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 >> 10.20.193.21:0/3276956268 conn(0x7f526c0b7990 msgr2=0x7f526c0b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.507 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 shutdown_connections 2026-02-25T15:07:30.508 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 -- 10.20.193.21:0/3276956268 wait complete. 2026-02-25T15:07:30.508 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.502+0000 7f5272e01640 1 librados: shutdown 2026-02-25T15:07:30.513 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-25T15:07:30.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.580+0000 7f5392c88640 10 monclient: get_monmap_and_config 2026-02-25T15:07:30.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.580+0000 7f5392c88640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.580+0000 7f5392c88640 10 monclient: monmap: 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.581598+0000 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.581598+0000 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.583 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 1 Processor -- start 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 1 -- start start 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient: init 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-b con 0x7f538c157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-c con 0x7f538c157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-a con 0x7f538c164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c05de70 con 0x7f538c164d00 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c055b20 con 0x7f538c157780 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c055e00 con 0x7f538c157b50 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.581+0000 7f5392c88640 10 monclient(hunting): authenticate will time out at 3394.173920s 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.582+0000 7f53909fd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f538c157780 0x7f538c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48514/0 (socket says 10.20.193.21:48514) 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.582+0000 7f53909fd640 1 -- 10.20.193.21:0/1878779115 learned_addr learned my addr 10.20.193.21:0/1878779115 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564886409 0 0) 0x7f538c055b20 con 0x7f538c157780 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): my global_id is 29191 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5378003610 con 0x7f538c157780 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959656643 0 0) 0x7f538c05de70 con 0x7f538c164d00 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): my global_id is 28218 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538c055b20 con 0x7f538c164d00 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339947914 0 0) 0x7f538c055e00 con 0x7f538c157b50 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 10 monclient(hunting): my global_id is 30845 2026-02-25T15:07:30.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.583+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538c05de70 con 0x7f538c157b50 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2924814131 0 0) 0x7f5378003610 con 0x7f538c157780 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 >> v1:10.20.193.68:6789/0 conn(0x7f538c157b50 legacy=0x7f538c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 >> v1:10.20.193.21:6789/0 conn(0x7f538c164d00 legacy=0x7f538c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 monclient: found mon.noname-b 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c0560e0 con 0x7f538c157780 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f537c002df0 con 0x7f538c157780 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: dump: 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.595 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f5392c88640 5 monclient: authenticate success, global_id 29191 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f5392c88640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f537c002fc0 con 0x7f538c157780 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 1 -- 10.20.193.21:0/1878779115 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f537c003400 con 0x7f538c157780 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f53837fe640 10 monclient: dump: 2026-02-25T15:07:30.596 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f5392c88640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.585+0000 7f5392c88640 4 set_mon_vals no callback set 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 10 monclient: shutdown 2026-02-25T15:07:30.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 -- 10.20.193.21:0/1878779115 >> v1:10.20.193.31:6789/0 conn(0x7f538c157780 legacy=0x7f538c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 -- 10.20.193.21:0/1878779115 shutdown_connections 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 -- 10.20.193.21:0/1878779115 >> 10.20.193.21:0/1878779115 conn(0x7f538c0b2ef0 msgr2=0x7f538c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 -- 10.20.193.21:0/1878779115 shutdown_connections 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 -- 10.20.193.21:0/1878779115 wait complete. 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 10 monclient: monmap: 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:30.598 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 librados: starting msgr at 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 librados: starting objecter 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.586+0000 7f5392c88640 1 Processor -- start 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 -- start start 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 librados: setting wanted keys 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 librados: calling monclient init 2026-02-25T15:07:30.599 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient: init 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-a con 0x7f538c157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-c con 0x7f538c157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient(hunting): picked mon.noname-b con 0x7f538c164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c130b60 con 0x7f538c157780 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c130e40 con 0x7f538c164d00 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c131120 con 0x7f538c157b50 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f5392c88640 10 monclient(hunting): authenticate will time out at 3394.179398s 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53909fd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f538c157780 0x7f538c0ae8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43318/0 (socket says 10.20.193.21:43318) 2026-02-25T15:07:30.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53909fd640 1 -- 10.20.193.21:0/2172531343 learned_addr learned my addr 10.20.193.21:0/2172531343 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53817fa640 10 client.?.objecter ms_handle_connect 0x7f538c164d00 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53817fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53817fa640 10 client.?.objecter ms_handle_connect 0x7f538c157780 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.587+0000 7f53817fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191669502 0 0) 0x7f538c130b60 con 0x7f538c157780 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): my global_id is 28221 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c003610 con 0x7f538c157780 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651706159 0 0) 0x7f538c130e40 con 0x7f538c164d00 2026-02-25T15:07:30.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 10 monclient(hunting): my global_id is 29194 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.588+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538c130b60 con 0x7f538c164d00 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.589+0000 7f53817fa640 10 client.?.objecter ms_handle_connect 0x7f538c157b50 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.589+0000 7f53817fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969784546 0 0) 0x7f538c131120 con 0x7f538c157b50 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 10 monclient(hunting): my global_id is 30848 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.590+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f538c130e40 con 0x7f538c157b50 2026-02-25T15:07:30.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3741641095 0 0) 0x7f538c130b60 con 0x7f538c164d00 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f538c131120 con 0x7f538c164d00 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f53880032f0 con 0x7f538c164d00 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.603 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3815097726 0 0) 0x7f535c003610 con 0x7f538c157780 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f538c130b60 con 0x7f538c157780 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f537c003310 con 0x7f538c157780 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.591+0000 7f53817fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.604 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2515411675 0 0) 0x7f538c130e40 con 0x7f538c157b50 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f535c003610 con 0x7f538c157b50 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5374003060 con 0x7f538c157b50 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient(hunting): dump: 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.606 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2267914368 0 0) 0x7f538c131120 con 0x7f538c164d00 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 >> v1:10.20.193.68:6789/0 conn(0x7f538c157b50 legacy=0x7f538c0ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 >> v1:10.20.193.21:6789/0 conn(0x7f538c157780 legacy=0x7f538c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 monclient: found mon.b 2026-02-25T15:07:30.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c131400 con 0x7f538c164d00 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f53817fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 5 monclient: authenticate success, global_id 29194 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 10 monclient: _renew_subs 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f538c1316e0 con 0x7f538c164d00 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 10 client.29194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 10 monclient: _renew_subs 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f538c156fd0 con 0x7f538c164d00 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.592+0000 7f5392c88640 1 librados: init done 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.593+0000 7f5392c88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.593+0000 7f5392c88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.593+0000 7f5392c88640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.593+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c0b5660 con 0x7f538c164d00 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5388003490 con 0x7f538c164d00 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5388003b30 con 0x7f538c164d00 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f5382ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:30.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.599+0000 7f53817fa640 10 monclient: dump: 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.600+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f538801ce70 con 0x7f538c164d00 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.601+0000 7f53909fd640 10 monclient: get_auth_request con 0x7f535c079ff0 auth_method 0 2026-02-25T15:07:30.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.601+0000 7f53817fa640 10 client.29194.objecter ms_handle_connect 0x7f535c079ff0 2026-02-25T15:07:30.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.602+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f5388094af0 con 0x7f538c164d00 2026-02-25T15:07:30.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.602+0000 7f53817fa640 10 client.29194.objecter ms_dispatch2 0x7f538c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:30.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.602+0000 7f53817fa640 3 client.29194.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:30.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.602+0000 7f53817fa640 3 client.29194.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:30.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.602+0000 7f53817fa640 20 client.29194.objecter dump_active .. 0 homeless 2026-02-25T15:07:30.689 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.688+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f538805e450 con 0x7f538c164d00 2026-02-25T15:07:30.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.688+0000 7f53817fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.690 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.688+0000 7f53817fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:30.796 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.794+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f538c0b5380 con 0x7f535c079ff0 2026-02-25T15:07:30.797 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.795+0000 7f53817fa640 1 -- 10.20.193.21:0/2172531343 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f538c0b5380 con 0x7f535c079ff0 2026-02-25T15:07:30.797 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 1 to deep-scrub 2026-02-25T15:07:30.798 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 10 librados: watch_flush enter 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 10 librados: watch_flush exit 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 20 client.29194.objecter shutdown clearing up homeless session... 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 10 client.29194.objecter successfully canceled tick 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 >> v1:10.20.193.72:6800/2463505645 conn(0x7f535c079ff0 legacy=0x7f535c09a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 10 monclient: shutdown 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 >> v1:10.20.193.31:6789/0 conn(0x7f538c164d00 legacy=0x7f538c1210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 shutdown_connections 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 >> 10.20.193.21:0/2172531343 conn(0x7f538c0b2ef0 msgr2=0x7f538c058bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 shutdown_connections 2026-02-25T15:07:30.799 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 -- 10.20.193.21:0/2172531343 wait complete. 2026-02-25T15:07:30.800 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.796+0000 7f5392c88640 1 librados: shutdown 2026-02-25T15:07:30.808 INFO:tasks.ceph:Scrubbing osd.5 2026-02-25T15:07:30.808 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:30.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 10 monclient: get_monmap_and_config 2026-02-25T15:07:30.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 10 monclient: monmap: 2026-02-25T15:07:30.878 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.876151+0000 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.876151+0000 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 1 Processor -- start 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 1 -- start start 2026-02-25T15:07:30.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.875+0000 7ff5de371640 10 monclient: init 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-c con 0x7ff5d815e2a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-a con 0x7ff5d8059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-b con 0x7ff5d81a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d8162df0 con 0x7ff5d8059e10 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d81630d0 con 0x7ff5d81a5660 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d81633b0 con 0x7ff5d815e2a0 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5de371640 10 monclient(hunting): authenticate will time out at 3394.468478s 2026-02-25T15:07:30.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5dc8e7640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7ff5d81a5660 0x7ff5d81c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48526/0 (socket says 10.20.193.21:48526) 2026-02-25T15:07:30.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.876+0000 7ff5dc8e7640 1 -- 10.20.193.21:0/868840466 learned_addr learned my addr 10.20.193.21:0/868840466 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997709004 0 0) 0x7ff5d81633b0 con 0x7ff5d815e2a0 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): my global_id is 30851 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5bc003610 con 0x7ff5d815e2a0 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277408637 0 0) 0x7ff5d81630d0 con 0x7ff5d81a5660 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): my global_id is 29197 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d81633b0 con 0x7ff5d81a5660 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103906874 0 0) 0x7ff5d8162df0 con 0x7ff5d8059e10 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 10 monclient(hunting): my global_id is 28224 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.878+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d81630d0 con 0x7ff5d8059e10 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058887332 0 0) 0x7ff5d81633b0 con 0x7ff5d81a5660 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 >> v1:10.20.193.68:6789/0 conn(0x7ff5d815e2a0 legacy=0x7ff5d805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 >> v1:10.20.193.21:6789/0 conn(0x7ff5d8059e10 legacy=0x7ff5d815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 monclient: found mon.noname-b 2026-02-25T15:07:30.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d8163690 con 0x7ff5d81a5660 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5cc003170 con 0x7ff5d81a5660 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5de371640 5 monclient: authenticate success, global_id 29197 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5de371640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.879+0000 7ff5d6ffd640 10 monclient: dump: 2026-02-25T15:07:30.889 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5de371640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5cc003310 con 0x7ff5d81a5660 2026-02-25T15:07:30.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 1 -- 10.20.193.21:0/868840466 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5cc003750 con 0x7ff5d81a5660 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5d6ffd640 10 monclient: dump: 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.891 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5de371640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.880+0000 7ff5de371640 4 set_mon_vals no callback set 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 10 monclient: shutdown 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- 10.20.193.21:0/868840466 >> v1:10.20.193.31:6789/0 conn(0x7ff5d81a5660 legacy=0x7ff5d81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- 10.20.193.21:0/868840466 shutdown_connections 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- 10.20.193.21:0/868840466 >> 10.20.193.21:0/868840466 conn(0x7ff5d80b2f60 msgr2=0x7ff5d80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- 10.20.193.21:0/868840466 shutdown_connections 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- 10.20.193.21:0/868840466 wait complete. 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 10 monclient: build_initial_monmap 2026-02-25T15:07:30.892 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 10 monclient: monmap: 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 librados: starting msgr at 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 librados: starting objecter 2026-02-25T15:07:30.893 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 Processor -- start 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 -- start start 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 librados: setting wanted keys 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 1 librados: calling monclient init 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.881+0000 7ff5de371640 10 monclient: init 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-b con 0x7ff5d8059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-c con 0x7ff5d815e2a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient(hunting): picked mon.noname-a con 0x7ff5d81a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d8128a10 con 0x7ff5d81a5660 2026-02-25T15:07:30.894 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d8191390 con 0x7ff5d8059e10 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d8191670 con 0x7ff5d815e2a0 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5de371640 10 monclient(hunting): authenticate will time out at 3394.474278s 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5dc8e7640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff5d81a5660 0x7ff5d80b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43332/0 (socket says 10.20.193.21:43332) 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5dc8e7640 1 -- 10.20.193.21:0/1534121270 learned_addr learned my addr 10.20.193.21:0/1534121270 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5d4ff9640 10 client.?.objecter ms_handle_connect 0x7ff5d81a5660 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.882+0000 7ff5d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 client.?.objecter ms_handle_connect 0x7ff5d815e2a0 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 client.?.objecter ms_handle_connect 0x7ff5d8059e10 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655042314 0 0) 0x7ff5d8128a10 con 0x7ff5d81a5660 2026-02-25T15:07:30.895 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): my global_id is 28227 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a8003610 con 0x7ff5d81a5660 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683050734 0 0) 0x7ff5d8191390 con 0x7ff5d8059e10 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 10 monclient(hunting): my global_id is 29200 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.883+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d8128a10 con 0x7ff5d8059e10 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972799196 0 0) 0x7ff5d8191670 con 0x7ff5d815e2a0 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:30.896 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:30.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:30.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 10 monclient(hunting): my global_id is 30854 2026-02-25T15:07:30.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.884+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5d8191390 con 0x7ff5d815e2a0 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3202083167 0 0) 0x7ff5a8003610 con 0x7ff5d81a5660 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5d8191670 con 0x7ff5d81a5660 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5cc003660 con 0x7ff5d81a5660 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:30.901 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:30.902 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1922242697 0 0) 0x7ff5d8128a10 con 0x7ff5d8059e10 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5a8003610 con 0x7ff5d8059e10 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5c4003020 con 0x7ff5d8059e10 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.903 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2594598360 0 0) 0x7ff5d8191390 con 0x7ff5d815e2a0 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5d8128a10 con 0x7ff5d815e2a0 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5c8002fb0 con 0x7ff5d815e2a0 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.886+0000 7ff5d4ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:30.904 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3503634443 0 0) 0x7ff5d8191670 con 0x7ff5d81a5660 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 >> v1:10.20.193.68:6789/0 conn(0x7ff5d815e2a0 legacy=0x7ff5d8192150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.905 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 >> v1:10.20.193.31:6789/0 conn(0x7ff5d8059e10 legacy=0x7ff5d812aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 1 monclient: found mon.a 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d8191950 con 0x7ff5d81a5660 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5d4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 5 monclient: authenticate success, global_id 28227 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 10 monclient: _renew_subs 2026-02-25T15:07:30.906 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d8191c30 con 0x7ff5d81a5660 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 10 client.28227.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 10 monclient: _renew_subs 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5d81291b0 con 0x7ff5d81a5660 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.887+0000 7ff5de371640 1 librados: init done 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 10 client.28227.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 15 client.28227.objecter _session_command_op_assign -1 1 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 20 client.28227.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 10 client.28227.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:30.907 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.888+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff5d815eeb0 con 0x7ff5d81a5660 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5d815eeb0 con 0x7ff5d81a5660 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff5cc004f00 con 0x7ff5d81a5660 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d4ff9640 10 monclient: dump: 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:30.908 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.896+0000 7ff5d67fc640 4 set_mon_vals no callback set 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.897+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff5cc01e3e0 con 0x7ff5d81a5660 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d7fff640 10 monclient: get_auth_request con 0x7ff5a807a0c0 auth_method 0 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 10 client.28227.objecter ms_handle_connect 0x7ff5a807a0c0 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7ff5cc095c00 con 0x7ff5d81a5660 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 10 client.28227.objecter ms_dispatch2 0x7ff5d8000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:30.909 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 3 client.28227.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 3 client.28227.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 10 client.28227.objecter checking command 1 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter _get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 15 client.28227.objecter _session_command_op_remove -1 1 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter _get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 15 client.28227.objecter _session_command_op_assign 5 1 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 4 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 10 client.28227.objecter _send_command 1 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.31:6812/2854385794 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5a80c66e0 con 0x7ff5a80a4a80 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 20 client.28227.objecter dump_active .. 0 homeless 2026-02-25T15:07:30.910 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7ff5cc05b1d0 con 0x7ff5d81a5660 2026-02-25T15:07:30.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.898+0000 7ff5d4ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:30.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.899+0000 7ff5d77fe640 10 monclient: get_auth_request con 0x7ff5a80a4a80 auth_method 0 2026-02-25T15:07:30.911 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.900+0000 7ff5d4ff9640 10 client.28227.objecter ms_handle_connect 0x7ff5a80a4a80 2026-02-25T15:07:30.912 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.909+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== osd.5 v1:10.20.193.31:6812/2854385794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff5a80c66e0 con 0x7ff5a80a4a80 2026-02-25T15:07:30.912 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.909+0000 7ff5d4ff9640 10 client.28227.objecter ms_dispatch2 0x7ff5d8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:30.912 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.909+0000 7ff5d4ff9640 10 client.28227.objecter _finish_command 1 = system:0 2026-02-25T15:07:30.912 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.909+0000 7ff5d4ff9640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 4 2026-02-25T15:07:30.912 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.909+0000 7ff5d4ff9640 15 client.28227.objecter _session_command_op_remove 5 1 2026-02-25T15:07:30.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 10 client.28227.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:30.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 15 client.28227.objecter _session_command_op_assign -1 2 2026-02-25T15:07:30.918 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 20 client.28227.objecter _get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 20 client.28227.objecter _get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 15 client.28227.objecter _session_command_op_remove -1 2 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 20 client.28227.objecter get_session s=0x7ff5a80a43d0 osd=5 3 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 15 client.28227.objecter _session_command_op_assign 5 2 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 4 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 10 client.28227.objecter _send_command 2 2026-02-25T15:07:30.919 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.916+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 --> v1:10.20.193.31:6812/2854385794 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff5d815d990 con 0x7ff5a80a4a80 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5d4ff9640 1 -- 10.20.193.21:0/1534121270 <== osd.5 v1:10.20.193.31:6812/2854385794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff5d815d990 con 0x7ff5a80a4a80 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5d4ff9640 10 client.28227.objecter ms_dispatch2 0x7ff5d8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5d4ff9640 10 client.28227.objecter _finish_command 2 = system:0 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5d4ff9640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 4 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5d4ff9640 15 client.28227.objecter _session_command_op_remove 5 2 2026-02-25T15:07:30.926 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:30.927 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:30.927 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:30.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 10 librados: watch_flush enter 2026-02-25T15:07:30.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 10 librados: watch_flush exit 2026-02-25T15:07:30.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 10 client.28227.objecter close_session for osd.5 2026-02-25T15:07:30.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 >> v1:10.20.193.31:6812/2854385794 conn(0x7ff5a80a4a80 legacy=0x7ff5a80c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.928 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 20 client.28227.objecter put_session s=0x7ff5a80a43d0 osd=5 1 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 20 client.28227.objecter shutdown clearing up homeless session... 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 10 client.28227.objecter successfully canceled tick 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff5a807a0c0 legacy=0x7ff5a809a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 10 monclient: shutdown 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 >> v1:10.20.193.21:6789/0 conn(0x7ff5d81a5660 legacy=0x7ff5d80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5dc8e7640 1 -- 10.20.193.21:0/1534121270 reap_dead start 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 shutdown_connections 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 >> 10.20.193.21:0/1534121270 conn(0x7ff5d80b2f60 msgr2=0x7ff5d8164170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 shutdown_connections 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 -- 10.20.193.21:0/1534121270 wait complete. 2026-02-25T15:07:30.929 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.924+0000 7ff5de371640 1 librados: shutdown 2026-02-25T15:07:30.933 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-25T15:07:31.000 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 10 monclient: get_monmap_and_config 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 10 monclient: monmap: 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:30.999824+0000 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:30.999824+0000 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.001 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.002 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.002 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.002 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 1 Processor -- start 2026-02-25T15:07:31.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 1 -- start start 2026-02-25T15:07:31.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:30.999+0000 7fa9506a6640 10 monclient: init 2026-02-25T15:07:31.003 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-a con 0x7fa948157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-b con 0x7fa948157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-c con 0x7fa948164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa94805de70 con 0x7fa948157780 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa948055b20 con 0x7fa948157b50 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa948055e00 con 0x7fa948164d00 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa9506a6640 10 monclient(hunting): authenticate will time out at 3394.592404s 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa94ec1c640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa948164d00 0x7fa9481c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:47960/0 (socket says 10.20.193.21:47960) 2026-02-25T15:07:31.004 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.000+0000 7fa94ec1c640 1 -- 10.20.193.21:0/215108811 learned_addr learned my addr 10.20.193.21:0/215108811 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207119871 0 0) 0x7fa948055e00 con 0x7fa948164d00 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): my global_id is 30857 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa930003610 con 0x7fa948164d00 2026-02-25T15:07:31.010 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874014285 0 0) 0x7fa94805de70 con 0x7fa948157780 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): my global_id is 28230 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa948055e00 con 0x7fa948157780 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266494878 0 0) 0x7fa948055b20 con 0x7fa948157b50 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 10 monclient(hunting): my global_id is 29203 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.002+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa94805de70 con 0x7fa948157b50 2026-02-25T15:07:31.011 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2612202182 0 0) 0x7fa930003610 con 0x7fa948164d00 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 >> v1:10.20.193.31:6789/0 conn(0x7fa948157b50 legacy=0x7fa9481645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 >> v1:10.20.193.21:6789/0 conn(0x7fa948157780 legacy=0x7fa948056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 monclient: found mon.noname-c 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9480560e0 con 0x7fa948164d00 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa944003170 con 0x7fa948164d00 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa9506a6640 5 monclient: authenticate success, global_id 30857 2026-02-25T15:07:31.012 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa9506a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa94d419640 10 monclient: dump: 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.013 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.003+0000 7fa9506a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa944003340 con 0x7fa948164d00 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 1 -- 10.20.193.21:0/215108811 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa944003780 con 0x7fa948164d00 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa94d419640 10 monclient: dump: 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.014 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 4 set_mon_vals no callback set 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 10 monclient: shutdown 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 1 -- 10.20.193.21:0/215108811 >> v1:10.20.193.68:6789/0 conn(0x7fa948164d00 legacy=0x7fa9481c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 1 -- 10.20.193.21:0/215108811 shutdown_connections 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 1 -- 10.20.193.21:0/215108811 >> 10.20.193.21:0/215108811 conn(0x7fa9480b2ef0 msgr2=0x7fa9480b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 1 -- 10.20.193.21:0/215108811 shutdown_connections 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.004+0000 7fa9506a6640 1 -- 10.20.193.21:0/215108811 wait complete. 2026-02-25T15:07:31.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 10 monclient: monmap: 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 librados: starting msgr at 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 librados: starting objecter 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:31.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 Processor -- start 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 -- start start 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 librados: setting wanted keys 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 1 librados: calling monclient init 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.005+0000 7fa9506a6640 10 monclient: init 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-c con 0x7fa948157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-b con 0x7fa948157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient(hunting): picked mon.noname-a con 0x7fa948164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa94805d690 con 0x7fa948164d00 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa948146e30 con 0x7fa948157b50 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa948147110 con 0x7fa948157780 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.017 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa9506a6640 10 monclient(hunting): authenticate will time out at 3394.598097s 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa94ec1c640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fa948164d00 0x7fa94813c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43360/0 (socket says 10.20.193.21:43360) 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa94ec1c640 1 -- 10.20.193.21:0/4003276742 learned_addr learned my addr 10.20.193.21:0/4003276742 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter ms_handle_connect 0x7fa948164d00 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter ms_handle_connect 0x7fa948157780 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter ms_handle_connect 0x7fa948157b50 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.006+0000 7fa92effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905166635 0 0) 0x7fa948147110 con 0x7fa948157780 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): my global_id is 30860 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa918003610 con 0x7fa948157780 2026-02-25T15:07:31.018 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051165800 0 0) 0x7fa94805d690 con 0x7fa948164d00 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): my global_id is 28233 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa948147110 con 0x7fa948164d00 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297643080 0 0) 0x7fa948146e30 con 0x7fa948157b50 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 10 monclient(hunting): my global_id is 29206 2026-02-25T15:07:31.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.007+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa94805d690 con 0x7fa948157b50 2026-02-25T15:07:31.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2900968467 0 0) 0x7fa948147110 con 0x7fa948164d00 2026-02-25T15:07:31.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa948146e30 con 0x7fa948164d00 2026-02-25T15:07:31.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa944003690 con 0x7fa948164d00 2026-02-25T15:07:31.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.009+0000 7fa92effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1831669276 0 0) 0x7fa918003610 con 0x7fa948157780 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa948147110 con 0x7fa948157780 2026-02-25T15:07:31.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa9380030b0 con 0x7fa948157780 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1043603731 0 0) 0x7fa94805d690 con 0x7fa948157b50 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa918003610 con 0x7fa948157b50 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa93c003060 con 0x7fa948157b50 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.023 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.010+0000 7fa92effd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 821314347 0 0) 0x7fa948146e30 con 0x7fa948164d00 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 >> v1:10.20.193.68:6789/0 conn(0x7fa948157780 legacy=0x7fa94805cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 >> v1:10.20.193.31:6789/0 conn(0x7fa948157b50 legacy=0x7fa9481399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 1 monclient: found mon.a 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.024 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9481473f0 con 0x7fa948164d00 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa92effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 5 monclient: authenticate success, global_id 28233 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 10 monclient: _renew_subs 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa9481391a0 con 0x7fa948164d00 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 10 client.28233.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 10 monclient: _renew_subs 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa94813a290 con 0x7fa948164d00 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.011+0000 7fa9506a6640 1 librados: init done 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.012+0000 7fa9506a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.012+0000 7fa9506a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.012+0000 7fa9506a6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:31.025 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.012+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94815f350 con 0x7fa948164d00 2026-02-25T15:07:31.103 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9440032f0 con 0x7fa948164d00 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fa944004f00 con 0x7fa948164d00 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 10 monclient: dump: 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.104 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.105 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.105 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.105 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.105 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.105 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa94cc18640 4 set_mon_vals no callback set 2026-02-25T15:07:31.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.102+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fa94401e3e0 con 0x7fa948164d00 2026-02-25T15:07:31.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.103+0000 7fa94e41b640 10 monclient: get_auth_request con 0x7fa91807a020 auth_method 0 2026-02-25T15:07:31.106 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.103+0000 7fa92effd640 10 client.28233.objecter ms_handle_connect 0x7fa91807a020 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fa944095c70 con 0x7fa948164d00 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 10 client.28233.objecter ms_dispatch2 0x7fa948000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 3 client.28233.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 3 client.28233.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 20 client.28233.objecter dump_active .. 0 homeless 2026-02-25T15:07:31.110 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fa94815f350 con 0x7fa948164d00 2026-02-25T15:07:31.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.111 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.108+0000 7fa92effd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:31.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.218+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa9480531e0 con 0x7fa91807a020 2026-02-25T15:07:31.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.218+0000 7fa92effd640 1 -- 10.20.193.21:0/4003276742 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fa9480531e0 con 0x7fa91807a020 2026-02-25T15:07:31.220 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 5 to deep-scrub 2026-02-25T15:07:31.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 10 librados: watch_flush enter 2026-02-25T15:07:31.221 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 10 librados: watch_flush exit 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 20 client.28233.objecter shutdown clearing up homeless session... 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 10 client.28233.objecter successfully canceled tick 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 >> v1:10.20.193.72:6800/2463505645 conn(0x7fa91807a020 legacy=0x7fa91809a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 10 monclient: shutdown 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 >> v1:10.20.193.21:6789/0 conn(0x7fa948164d00 legacy=0x7fa94813c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 shutdown_connections 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 >> 10.20.193.21:0/4003276742 conn(0x7fa9480b2ef0 msgr2=0x7fa94815ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 shutdown_connections 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 -- 10.20.193.21:0/4003276742 wait complete. 2026-02-25T15:07:31.222 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.220+0000 7fa9506a6640 1 librados: shutdown 2026-02-25T15:07:31.230 INFO:tasks.ceph:Scrubbing osd.9 2026-02-25T15:07:31.230 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:31.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.299+0000 7fcfe545b640 10 monclient: get_monmap_and_config 2026-02-25T15:07:31.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.299+0000 7fcfe545b640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.299+0000 7fcfe545b640 10 monclient: monmap: 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:31.300531+0000 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:31.300531+0000 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.302 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 1 Processor -- start 2026-02-25T15:07:31.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 1 -- start start 2026-02-25T15:07:31.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient: init 2026-02-25T15:07:31.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.305 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-a con 0x7fcfe0159a60 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-c con 0x7fcfe0058130 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-b con 0x7fcfe00b1ca0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00b5230 con 0x7fcfe0159a60 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.300+0000 7fcfe545b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00b5510 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.301+0000 7fcfe545b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00b57f0 con 0x7fcfe0058130 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.301+0000 7fcfe545b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.301+0000 7fcfe545b640 10 monclient(hunting): authenticate will time out at 3394.893004s 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.301+0000 7fcfdeffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fcfe0159a60 0x7fcfe00b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43364/0 (socket says 10.20.193.21:43364) 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.301+0000 7fcfdeffd640 1 -- 10.20.193.21:0/1461966340 learned_addr learned my addr 10.20.193.21:0/1461966340 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2154259941 0 0) 0x7fcfe00b5510 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): my global_id is 29209 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfcc003610 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829745147 0 0) 0x7fcfe00b57f0 con 0x7fcfe0058130 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): my global_id is 30863 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe00b5510 con 0x7fcfe0058130 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747284882 0 0) 0x7fcfe00b5230 con 0x7fcfe0159a60 2026-02-25T15:07:31.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 10 monclient(hunting): my global_id is 28236 2026-02-25T15:07:31.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.302+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe00b57f0 con 0x7fcfe0159a60 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2638619323 0 0) 0x7fcfcc003610 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 >> v1:10.20.193.68:6789/0 conn(0x7fcfe0058130 legacy=0x7fcfe00b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 >> v1:10.20.193.21:6789/0 conn(0x7fcfe0159a60 legacy=0x7fcfe00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 monclient: found mon.noname-b 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe00b5ad0 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfd0003170 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfddffb640 10 monclient: dump: 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.313 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfe545b640 5 monclient: authenticate success, global_id 29209 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.304+0000 7fcfe545b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfd0003340 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 1 -- 10.20.193.21:0/1461966340 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfd0003780 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfddffb640 10 monclient: dump: 2026-02-25T15:07:31.314 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 4 set_mon_vals no callback set 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 10 monclient: shutdown 2026-02-25T15:07:31.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 1 -- 10.20.193.21:0/1461966340 >> v1:10.20.193.31:6789/0 conn(0x7fcfe00b1ca0 legacy=0x7fcfe0166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 1 -- 10.20.193.21:0/1461966340 shutdown_connections 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 1 -- 10.20.193.21:0/1461966340 >> 10.20.193.21:0/1461966340 conn(0x7fcfe00b3650 msgr2=0x7fcfe00b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 1 -- 10.20.193.21:0/1461966340 shutdown_connections 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.305+0000 7fcfe545b640 1 -- 10.20.193.21:0/1461966340 wait complete. 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient: monmap: 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:31.316 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 librados: starting msgr at 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 librados: starting objecter 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 Processor -- start 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 -- start start 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 librados: setting wanted keys 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 librados: calling monclient init 2026-02-25T15:07:31.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient: init 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-c con 0x7fcfe0058130 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-a con 0x7fcfe00b1ca0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient(hunting): picked mon.noname-b con 0x7fcfe0159a60 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe01340c0 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe0134380 con 0x7fcfe0159a60 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe0134660 con 0x7fcfe0058130 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.306+0000 7fcfe545b640 10 monclient(hunting): authenticate will time out at 3394.898982s 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfdeffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fcfe0058130 0x7fcfe011d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48010/0 (socket says 10.20.193.21:48010) 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfdeffd640 1 -- 10.20.193.21:0/1708364020 learned_addr learned my addr 10.20.193.21:0/1708364020 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter ms_handle_connect 0x7fcfe0159a60 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter ms_handle_connect 0x7fcfe0058130 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter ms_handle_connect 0x7fcfe00b1ca0 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.307+0000 7fcfbf7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647438280 0 0) 0x7fcfe0134380 con 0x7fcfe0159a60 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): my global_id is 29212 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfac003610 con 0x7fcfe0159a60 2026-02-25T15:07:31.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674474497 0 0) 0x7fcfe0134660 con 0x7fcfe0058130 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): my global_id is 30866 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe0134380 con 0x7fcfe0058130 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413337476 0 0) 0x7fcfe01340c0 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 10 monclient(hunting): my global_id is 28239 2026-02-25T15:07:31.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.308+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe0134660 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2044017601 0 0) 0x7fcfe0134380 con 0x7fcfe0058130 2026-02-25T15:07:31.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfe01340c0 con 0x7fcfe0058130 2026-02-25T15:07:31.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfd4002fa0 con 0x7fcfe0058130 2026-02-25T15:07:31.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): dump: 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 938878649 0 0) 0x7fcfac003610 con 0x7fcfe0159a60 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfe0134380 con 0x7fcfe0159a60 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfd00034f0 con 0x7fcfe0159a60 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): dump: 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.325 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1264434749 0 0) 0x7fcfe0134660 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfac003610 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfc8003070 con 0x7fcfe00b1ca0 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.311+0000 7fcfbf7fe640 10 monclient(hunting): dump: 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.326 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2323490536 0 0) 0x7fcfe01340c0 con 0x7fcfe0058130 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 >> v1:10.20.193.31:6789/0 conn(0x7fcfe0159a60 legacy=0x7fcfe0140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 >> v1:10.20.193.21:6789/0 conn(0x7fcfe00b1ca0 legacy=0x7fcfe005cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 1 monclient: found mon.c 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe0134940 con 0x7fcfe0058130 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 5 monclient: authenticate success, global_id 30866 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 10 monclient: _renew_subs 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe0134c20 con 0x7fcfe0058130 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 10 client.30866.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 10 monclient: _renew_subs 2026-02-25T15:07:31.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcfe01351e0 con 0x7fcfe0058130 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.312+0000 7fcfe545b640 1 librados: init done 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 10 client.30866.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 15 client.30866.objecter _session_command_op_assign -1 1 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 20 client.30866.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 10 client.30866.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.313+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fcfe0132010 con 0x7fcfe0058130 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfd4003170 con 0x7fcfe0058130 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcfd4004a70 con 0x7fcfe0058130 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.329 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfbf7fe640 10 monclient: dump: 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.330 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.321+0000 7fcfdd7fa640 4 set_mon_vals no callback set 2026-02-25T15:07:31.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.322+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fcfd4004c50 con 0x7fcfe0058130 2026-02-25T15:07:31.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.323+0000 7fcfde7fc640 10 monclient: get_auth_request con 0x7fcfac07a020 auth_method 0 2026-02-25T15:07:31.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.323+0000 7fcfbf7fe640 10 client.30866.objecter ms_handle_connect 0x7fcfac07a020 2026-02-25T15:07:31.332 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fcfd405ac00 con 0x7fcfe0058130 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 10 client.30866.objecter ms_dispatch2 0x7fcfe0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 3 client.30866.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 3 client.30866.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 10 client.30866.objecter checking command 1 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter _get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 15 client.30866.objecter _session_command_op_remove -1 1 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter _get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 15 client.30866.objecter _session_command_op_assign 9 1 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 4 2026-02-25T15:07:31.333 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 10 client.30866.objecter _send_command 1 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.31:6800/3462355980 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfac0c6680 con 0x7fcfac0a4980 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 20 client.30866.objecter dump_active .. 0 homeless 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fcfd405afe0 con 0x7fcfe0058130 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfbf7fe640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.324+0000 7fcfdf7fe640 10 monclient: get_auth_request con 0x7fcfac0a4980 auth_method 0 2026-02-25T15:07:31.334 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.325+0000 7fcfbf7fe640 10 client.30866.objecter ms_handle_connect 0x7fcfac0a4980 2026-02-25T15:07:31.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.334+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== osd.9 v1:10.20.193.31:6800/3462355980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fcfac0c6680 con 0x7fcfac0a4980 2026-02-25T15:07:31.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.334+0000 7fcfbf7fe640 10 client.30866.objecter ms_dispatch2 0x7fcfe0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:31.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.334+0000 7fcfbf7fe640 10 client.30866.objecter _finish_command 1 = system:0 2026-02-25T15:07:31.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.335+0000 7fcfbf7fe640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 4 2026-02-25T15:07:31.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.335+0000 7fcfbf7fe640 15 client.30866.objecter _session_command_op_remove 9 1 2026-02-25T15:07:31.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 10 client.30866.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:31.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 15 client.30866.objecter _session_command_op_assign -1 2 2026-02-25T15:07:31.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 20 client.30866.objecter _get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 20 client.30866.objecter _get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 15 client.30866.objecter _session_command_op_remove -1 2 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 20 client.30866.objecter get_session s=0x7fcfac0a42d0 osd=9 3 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 15 client.30866.objecter _session_command_op_assign 9 2 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 4 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 10 client.30866.objecter _send_command 2 2026-02-25T15:07:31.345 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.342+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 --> v1:10.20.193.31:6800/3462355980 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcfe0132950 con 0x7fcfac0a4980 2026-02-25T15:07:31.351 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.349+0000 7fcfbf7fe640 1 -- 10.20.193.21:0/1708364020 <== osd.9 v1:10.20.193.31:6800/3462355980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fcfd0005e70 con 0x7fcfac0a4980 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.349+0000 7fcfbf7fe640 10 client.30866.objecter ms_dispatch2 0x7fcfe0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.349+0000 7fcfbf7fe640 10 client.30866.objecter _finish_command 2 = system:0 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.349+0000 7fcfbf7fe640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 4 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.349+0000 7fcfbf7fe640 15 client.30866.objecter _session_command_op_remove 9 2 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:31.352 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 10 librados: watch_flush enter 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 10 librados: watch_flush exit 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 10 client.30866.objecter close_session for osd.9 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 >> v1:10.20.193.31:6800/3462355980 conn(0x7fcfac0a4980 legacy=0x7fcfac0c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 20 client.30866.objecter put_session s=0x7fcfac0a42d0 osd=9 1 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 20 client.30866.objecter shutdown clearing up homeless session... 2026-02-25T15:07:31.354 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 10 client.30866.objecter successfully canceled tick 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 >> v1:10.20.193.72:6800/2463505645 conn(0x7fcfac07a020 legacy=0x7fcfac09a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 10 monclient: shutdown 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 >> v1:10.20.193.68:6789/0 conn(0x7fcfe0058130 legacy=0x7fcfe011d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfdf7fe640 1 -- 10.20.193.21:0/1708364020 reap_dead start 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 shutdown_connections 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 >> 10.20.193.21:0/1708364020 conn(0x7fcfe00b3650 msgr2=0x7fcfe00b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 shutdown_connections 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 -- 10.20.193.21:0/1708364020 wait complete. 2026-02-25T15:07:31.355 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.350+0000 7fcfe545b640 1 librados: shutdown 2026-02-25T15:07:31.360 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.426+0000 7f3f0cf5c640 10 monclient: get_monmap_and_config 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.426+0000 7f3f0cf5c640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.426+0000 7f3f0cf5c640 10 monclient: monmap: 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:31.427583+0000 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:31.427583+0000 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.428 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.427+0000 7f3f0cf5c640 1 Processor -- start 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.427+0000 7f3f0cf5c640 1 -- start start 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.427+0000 7f3f0cf5c640 10 monclient: init 2026-02-25T15:07:31.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-c con 0x7f3f080b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-b con 0x7f3f080ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-a con 0x7f3f080585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f08163930 con 0x7f3f080585e0 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f08163bb0 con 0x7f3f080ba350 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f08163e90 con 0x7f3f080b9f80 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f0cf5c640 10 monclient(hunting): authenticate will time out at 3395.020143s 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f06575640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3f080b9f80 0x7f3f08163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48022/0 (socket says 10.20.193.21:48022) 2026-02-25T15:07:31.430 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.428+0000 7f3f06575640 1 -- 10.20.193.21:0/2327090050 learned_addr learned my addr 10.20.193.21:0/2327090050 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752574978 0 0) 0x7f3f08163e90 con 0x7f3f080b9f80 2026-02-25T15:07:31.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.431 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 10 monclient(hunting): my global_id is 30869 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.429+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ef4003610 con 0x7f3f080b9f80 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159828903 0 0) 0x7f3f08163bb0 con 0x7f3f080ba350 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): my global_id is 29215 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f08163e90 con 0x7f3f080ba350 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012377747 0 0) 0x7f3ef8002c90 con 0x7f3f080585e0 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 10 monclient(hunting): my global_id is 28242 2026-02-25T15:07:31.432 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.430+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f08163bb0 con 0x7f3f080585e0 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 636224523 0 0) 0x7f3ef4003610 con 0x7f3f080b9f80 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 >> v1:10.20.193.31:6789/0 conn(0x7f3f080ba350 legacy=0x7f3f08057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 >> v1:10.20.193.21:6789/0 conn(0x7f3f080585e0 legacy=0x7f3f08166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 monclient: found mon.noname-c 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f080573f0 con 0x7f3f080b9f80 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.433 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3efc002df0 con 0x7f3f080b9f80 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f05573640 10 monclient: dump: 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f0cf5c640 5 monclient: authenticate success, global_id 30869 2026-02-25T15:07:31.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.431+0000 7f3f0cf5c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3efc002fc0 con 0x7f3f080b9f80 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 1 -- 10.20.193.21:0/2327090050 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3efc003400 con 0x7f3f080b9f80 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f05573640 10 monclient: dump: 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 4 set_mon_vals no callback set 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 10 monclient: shutdown 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/2327090050 >> v1:10.20.193.68:6789/0 conn(0x7f3f080b9f80 legacy=0x7f3f08163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/2327090050 shutdown_connections 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/2327090050 >> 10.20.193.21:0/2327090050 conn(0x7f3f080b7990 msgr2=0x7f3f080b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/2327090050 shutdown_connections 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.432+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/2327090050 wait complete. 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 10 monclient: monmap: 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 librados: starting msgr at 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 librados: starting objecter 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 Processor -- start 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 -- start start 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 librados: setting wanted keys 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 1 librados: calling monclient init 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.433+0000 7f3f0cf5c640 10 monclient: init 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-c con 0x7f3f080585e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-a con 0x7f3f080b9f80 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient(hunting): picked mon.noname-b con 0x7f3f080ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f081fca90 con 0x7f3f080b9f80 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f081fcd70 con 0x7f3f080ba350 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f081fd050 con 0x7f3f080585e0 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f0cf5c640 10 monclient(hunting): authenticate will time out at 3395.026144s 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f05d74640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f3f080b9f80 0x7f3f08155880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43398/0 (socket says 10.20.193.21:43398) 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3f05d74640 1 -- 10.20.193.21:0/3116112085 learned_addr learned my addr 10.20.193.21:0/3116112085 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter ms_handle_connect 0x7f3f080b9f80 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter ms_handle_connect 0x7f3f080ba350 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter ms_handle_connect 0x7f3f080585e0 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.434+0000 7f3eeeffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061263808 0 0) 0x7f3f081fca90 con 0x7f3f080b9f80 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): my global_id is 28245 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ed4003610 con 0x7f3f080b9f80 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567725496 0 0) 0x7f3f081fcd70 con 0x7f3f080ba350 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): my global_id is 29218 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f081fca90 con 0x7f3f080ba350 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126773609 0 0) 0x7f3f081fd050 con 0x7f3f080585e0 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 10 monclient(hunting): my global_id is 30872 2026-02-25T15:07:31.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.435+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f081fcd70 con 0x7f3f080585e0 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2110015246 0 0) 0x7f3f081fca90 con 0x7f3f080ba350 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f081fd050 con 0x7f3f080ba350 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3ef80035e0 con 0x7f3f080ba350 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.440 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.437+0000 7f3eeeffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1998994796 0 0) 0x7f3ed4003610 con 0x7f3f080b9f80 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f081fca90 con 0x7f3f080b9f80 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3ef00030f0 con 0x7f3f080b9f80 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 295320243 0 0) 0x7f3f081fcd70 con 0x7f3f080585e0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ed4003610 con 0x7f3f080585e0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3efc003310 con 0x7f3f080585e0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.438+0000 7f3eeeffd640 10 monclient(hunting): dump: 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1161218428 0 0) 0x7f3f081fd050 con 0x7f3f080ba350 2026-02-25T15:07:31.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 >> v1:10.20.193.68:6789/0 conn(0x7f3f080585e0 legacy=0x7f3f081fde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 >> v1:10.20.193.21:6789/0 conn(0x7f3f080b9f80 legacy=0x7f3f08155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 1 monclient: found mon.b 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f081fd330 con 0x7f3f080ba350 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3eeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 5 monclient: authenticate success, global_id 29218 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 10 monclient: _renew_subs 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f081fd610 con 0x7f3f080ba350 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 10 client.29218.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 10 monclient: _renew_subs 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f081f91b0 con 0x7f3f080ba350 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.439+0000 7f3f0cf5c640 1 librados: init done 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.440+0000 7f3f0cf5c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.440+0000 7f3f0cf5c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.440+0000 7f3f0cf5c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.440+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f080b64c0 con 0x7f3f080ba350 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ef8003a80 con 0x7f3f080ba350 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f3ef8003c30 con 0x7f3f080ba350 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3f04d72640 4 set_mon_vals no callback set 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.447+0000 7f3eeeffd640 10 monclient: dump: 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.448+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f3ef801d150 con 0x7f3f080ba350 2026-02-25T15:07:31.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f3ef8094bb0 con 0x7f3f080ba350 2026-02-25T15:07:31.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 10 client.29218.objecter ms_dispatch2 0x7f3f08000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:31.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 3 client.29218.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:31.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 3 client.29218.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:31.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3f06575640 10 monclient: get_auth_request con 0x7f3ed407a040 auth_method 0 2026-02-25T15:07:31.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 20 client.29218.objecter dump_active .. 0 homeless 2026-02-25T15:07:31.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.449+0000 7f3eeeffd640 10 client.29218.objecter ms_handle_connect 0x7f3ed407a040 2026-02-25T15:07:31.536 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.535+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f3f08163930 con 0x7f3f080ba350 2026-02-25T15:07:31.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.535+0000 7f3eeeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.537 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.535+0000 7f3eeeffd640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:31.641 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.638+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f3f08159390 con 0x7f3ed407a040 2026-02-25T15:07:31.641 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.639+0000 7f3eeeffd640 1 -- 10.20.193.21:0/3116112085 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f3f08159390 con 0x7f3ed407a040 2026-02-25T15:07:31.641 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 9 to deep-scrub 2026-02-25T15:07:31.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.639+0000 7f3f0cf5c640 10 librados: watch_flush enter 2026-02-25T15:07:31.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.639+0000 7f3f0cf5c640 10 librados: watch_flush exit 2026-02-25T15:07:31.642 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 20 client.29218.objecter shutdown clearing up homeless session... 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 10 client.29218.objecter successfully canceled tick 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 >> v1:10.20.193.72:6800/2463505645 conn(0x7f3ed407a040 legacy=0x7f3ed409a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 10 monclient: shutdown 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 >> v1:10.20.193.31:6789/0 conn(0x7f3f080ba350 legacy=0x7f3f080b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 shutdown_connections 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 >> 10.20.193.21:0/3116112085 conn(0x7f3f080b7990 msgr2=0x7f3f0815b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 shutdown_connections 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 -- 10.20.193.21:0/3116112085 wait complete. 2026-02-25T15:07:31.643 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.640+0000 7f3f0cf5c640 1 librados: shutdown 2026-02-25T15:07:31.650 INFO:tasks.ceph:Scrubbing osd.13 2026-02-25T15:07:31.650 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:31.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.719+0000 7f4666ebf640 10 monclient: get_monmap_and_config 2026-02-25T15:07:31.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.719+0000 7f4666ebf640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.719+0000 7f4666ebf640 10 monclient: monmap: 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:31.720565+0000 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:31.720565+0000 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.722 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 1 Processor -- start 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 1 -- start start 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient: init 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f46601667a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f4660165cf0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f4660159b10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466005e260 con 0x7f4660165cf0 2026-02-25T15:07:31.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4660164540 con 0x7f4660159b10 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4660164820 con 0x7f46601667a0 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.720+0000 7f4666ebf640 10 monclient(hunting): authenticate will time out at 3395.312874s 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.721+0000 7f4664c34640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f46601667a0 0x7f46601655e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48050/0 (socket says 10.20.193.21:48050) 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.721+0000 7f4664c34640 1 -- 10.20.193.21:0/144497662 learned_addr learned my addr 10.20.193.21:0/144497662 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168025535 0 0) 0x7f4660164820 con 0x7f46601667a0 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): my global_id is 30875 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f464c003610 con 0x7f46601667a0 2026-02-25T15:07:31.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961630494 0 0) 0x7f4660164540 con 0x7f4660159b10 2026-02-25T15:07:31.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 10 monclient(hunting): my global_id is 29221 2026-02-25T15:07:31.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.722+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4660164820 con 0x7f4660159b10 2026-02-25T15:07:31.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3534130198 0 0) 0x7f464c003610 con 0x7f46601667a0 2026-02-25T15:07:31.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 >> v1:10.20.193.31:6789/0 conn(0x7f4660159b10 legacy=0x7f46601c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.731 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 >> v1:10.20.193.21:6789/0 conn(0x7f4660165cf0 legacy=0x7f4660159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 monclient: found mon.noname-c 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4660164b00 con 0x7f46601667a0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4650002df0 con 0x7f46601667a0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.732 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: dump: 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f4666ebf640 5 monclient: authenticate success, global_id 30875 2026-02-25T15:07:31.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f4666ebf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4650003000 con 0x7f46601667a0 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 4 set_mon_vals no callback set 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.724+0000 7f46577fe640 1 -- 10.20.193.21:0/144497662 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4650003440 con 0x7f46601667a0 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f46577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f46577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f46577fe640 10 monclient: dump: 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.734 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 10 monclient: shutdown 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 -- 10.20.193.21:0/144497662 >> v1:10.20.193.68:6789/0 conn(0x7f46601667a0 legacy=0x7f46601655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 -- 10.20.193.21:0/144497662 shutdown_connections 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 -- 10.20.193.21:0/144497662 >> 10.20.193.21:0/144497662 conn(0x7f46600b2f60 msgr2=0x7f46600b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 -- 10.20.193.21:0/144497662 shutdown_connections 2026-02-25T15:07:31.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 -- 10.20.193.21:0/144497662 wait complete. 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 10 monclient: monmap: 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.736 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 librados: starting msgr at 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.725+0000 7f4666ebf640 1 librados: starting objecter 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 Processor -- start 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 -- start start 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 librados: setting wanted keys 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 librados: calling monclient init 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient: init 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-a con 0x7f4660159b10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-b con 0x7f4660165cf0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient(hunting): picked mon.noname-c con 0x7f46601667a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4660056f30 con 0x7f4660159b10 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4660057210 con 0x7f4660165cf0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600574f0 con 0x7f46601667a0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4666ebf640 10 monclient(hunting): authenticate will time out at 3395.318500s 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4665435640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f46601667a0 0x7f46601581d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48064/0 (socket says 10.20.193.21:48064) 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.726+0000 7f4665435640 1 -- 10.20.193.21:0/1972049444 learned_addr learned my addr 10.20.193.21:0/1972049444 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 client.?.objecter ms_handle_connect 0x7f46601667a0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 client.?.objecter ms_handle_connect 0x7f4660165cf0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154276794 0 0) 0x7f46600574f0 con 0x7f46601667a0 2026-02-25T15:07:31.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 10 monclient(hunting): my global_id is 30878 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.727+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4630003610 con 0x7f46601667a0 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097334009 0 0) 0x7f4660057210 con 0x7f4660165cf0 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 monclient(hunting): my global_id is 29224 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46600574f0 con 0x7f4660165cf0 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 client.?.objecter ms_handle_connect 0x7f4660159b10 2026-02-25T15:07:31.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.728+0000 7f46557fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2568417877 0 0) 0x7f46600574f0 con 0x7f4660165cf0 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4660057210 con 0x7f4660165cf0 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4648002fc0 con 0x7f4660165cf0 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): dump: 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.742 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810302979 0 0) 0x7f4660056f30 con 0x7f4660159b10 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 10 monclient(hunting): my global_id is 28248 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.730+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46600574f0 con 0x7f4660159b10 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 738772169 0 0) 0x7f4660057210 con 0x7f4660165cf0 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 >> v1:10.20.193.68:6789/0 conn(0x7f46601667a0 legacy=0x7f46601581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 >> v1:10.20.193.21:6789/0 conn(0x7f4660159b10 legacy=0x7f46600582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 1 monclient: found mon.b 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46600577d0 con 0x7f4660165cf0 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f46557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 5 monclient: authenticate success, global_id 29224 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 monclient: _renew_subs 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4660057ab0 con 0x7f4660165cf0 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 client.29224.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 monclient: _renew_subs 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4660056c70 con 0x7f4660165cf0 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 1 librados: init done 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 client.29224.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 15 client.29224.objecter _session_command_op_assign -1 1 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 20 client.29224.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:31.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 client.29224.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.732+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4660059c60 con 0x7f4660165cf0 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4660059c60 con 0x7f4660165cf0 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f46480033b0 con 0x7f4660165cf0 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 10 monclient: dump: 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.746 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.747 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f4656ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:31.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.740+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f46480035c0 con 0x7f4660165cf0 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f4664c34640 10 monclient: get_auth_request con 0x7f4630079fe0 auth_method 0 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f46480948a0 con 0x7f4660165cf0 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 10 client.29224.objecter ms_dispatch2 0x7f4660000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 3 client.29224.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 3 client.29224.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 10 client.29224.objecter checking command 1 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter _get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 15 client.29224.objecter _session_command_op_remove -1 1 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter _get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 15 client.29224.objecter _session_command_op_assign 13 1 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 4 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 10 client.29224.objecter _send_command 1 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6801/981225706 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46300c6600 con 0x7f46300a49a0 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 20 client.29224.objecter dump_active .. 0 homeless 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f464805d8d0 con 0x7f4660165cf0 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.741+0000 7f46557fa640 10 client.29224.objecter ms_handle_connect 0x7f4630079fe0 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.742+0000 7f4665435640 10 monclient: get_auth_request con 0x7f46300a49a0 auth_method 0 2026-02-25T15:07:31.750 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.743+0000 7f46557fa640 10 client.29224.objecter ms_handle_connect 0x7f46300a49a0 2026-02-25T15:07:31.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.752+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== osd.13 v1:10.20.193.31:6801/981225706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f46300c6600 con 0x7f46300a49a0 2026-02-25T15:07:31.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.752+0000 7f46557fa640 10 client.29224.objecter ms_dispatch2 0x7f4660000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:31.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.752+0000 7f46557fa640 10 client.29224.objecter _finish_command 1 = system:0 2026-02-25T15:07:31.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.752+0000 7f46557fa640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 4 2026-02-25T15:07:31.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.752+0000 7f46557fa640 15 client.29224.objecter _session_command_op_remove 13 1 2026-02-25T15:07:31.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 10 client.29224.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:31.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 15 client.29224.objecter _session_command_op_assign -1 2 2026-02-25T15:07:31.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 20 client.29224.objecter _get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 20 client.29224.objecter _get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 15 client.29224.objecter _session_command_op_remove -1 2 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 20 client.29224.objecter get_session s=0x7f46300a42f0 osd=13 3 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 15 client.29224.objecter _session_command_op_assign 13 2 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 4 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 10 client.29224.objecter _send_command 2 2026-02-25T15:07:31.762 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.759+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 --> v1:10.20.193.31:6801/981225706 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4660157cb0 con 0x7f46300a49a0 2026-02-25T15:07:31.768 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.766+0000 7f46557fa640 1 -- 10.20.193.21:0/1972049444 <== osd.13 v1:10.20.193.31:6801/981225706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f4660157cb0 con 0x7f46300a49a0 2026-02-25T15:07:31.768 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.766+0000 7f46557fa640 10 client.29224.objecter ms_dispatch2 0x7f4660000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.766+0000 7f46557fa640 10 client.29224.objecter _finish_command 2 = system:0 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.766+0000 7f46557fa640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 4 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.766+0000 7f46557fa640 15 client.29224.objecter _session_command_op_remove 13 2 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:31.769 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 10 librados: watch_flush enter 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 10 librados: watch_flush exit 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 10 client.29224.objecter close_session for osd.13 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 >> v1:10.20.193.31:6801/981225706 conn(0x7f46300a49a0 legacy=0x7f46300c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 20 client.29224.objecter put_session s=0x7f46300a42f0 osd=13 1 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 20 client.29224.objecter shutdown clearing up homeless session... 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 10 client.29224.objecter successfully canceled tick 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 >> v1:10.20.193.72:6800/2463505645 conn(0x7f4630079fe0 legacy=0x7f463009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 10 monclient: shutdown 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 >> v1:10.20.193.31:6789/0 conn(0x7f4660165cf0 legacy=0x7f4660151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4665435640 1 -- 10.20.193.21:0/1972049444 reap_dead start 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 shutdown_connections 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 >> 10.20.193.21:0/1972049444 conn(0x7f46600b2f60 msgr2=0x7f46600a92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 shutdown_connections 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 -- 10.20.193.21:0/1972049444 wait complete. 2026-02-25T15:07:31.772 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.767+0000 7f4666ebf640 1 librados: shutdown 2026-02-25T15:07:31.776 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-25T15:07:31.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.841+0000 7f01eb9c8640 10 monclient: get_monmap_and_config 2026-02-25T15:07:31.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.841+0000 7f01eb9c8640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.843 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.841+0000 7f01eb9c8640 10 monclient: monmap: 2026-02-25T15:07:31.843 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.843 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:31.842245+0000 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:31.842245+0000 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.844 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.846 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 1 Processor -- start 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 1 -- start start 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient: init 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-c con 0x7f01e4157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-b con 0x7f01e4157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-a con 0x7f01e4164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e405de70 con 0x7f01e4164d00 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e4055b20 con 0x7f01e4157b50 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e4055e00 con 0x7f01e4157780 2026-02-25T15:07:31.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01eb9c8640 10 monclient(hunting): authenticate will time out at 3395.434574s 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01e9f3e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f01e4164d00 0x7f01e41c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43440/0 (socket says 10.20.193.21:43440) 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01e9f3e640 1 -- 10.20.193.21:0/2132480412 learned_addr learned my addr 10.20.193.21:0/2132480412 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.842+0000 7f01e973d640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f01e4157780 0x7f01e4056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48068/0 (socket says 10.20.193.21:48068) 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562296345 0 0) 0x7f01e405de70 con 0x7f01e4164d00 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): my global_id is 28251 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01cc003610 con 0x7f01e4164d00 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230929274 0 0) 0x7f01e4055e00 con 0x7f01e4157780 2026-02-25T15:07:31.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): my global_id is 30881 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01e405de70 con 0x7f01e4157780 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816152363 0 0) 0x7f01e4055b20 con 0x7f01e4157b50 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 10 monclient(hunting): my global_id is 29227 2026-02-25T15:07:31.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.844+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01e4055e00 con 0x7f01e4157b50 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1524082321 0 0) 0x7f01cc003610 con 0x7f01e4164d00 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 >> v1:10.20.193.68:6789/0 conn(0x7f01e4157780 legacy=0x7f01e4056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 >> v1:10.20.193.31:6789/0 conn(0x7f01e4157b50 legacy=0x7f01e41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 monclient: found mon.noname-a 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e40560e0 con 0x7f01e4164d00 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01e0003170 con 0x7f01e4164d00 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01d3fff640 10 monclient: dump: 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.856 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01eb9c8640 5 monclient: authenticate success, global_id 28251 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.846+0000 7f01eb9c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01e0003340 con 0x7f01e4164d00 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 1 -- 10.20.193.21:0/2132480412 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01e0003780 con 0x7f01e4164d00 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01d3fff640 10 monclient: dump: 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 4 set_mon_vals no callback set 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 10 monclient: shutdown 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2132480412 >> v1:10.20.193.21:6789/0 conn(0x7f01e4164d00 legacy=0x7f01e41c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2132480412 shutdown_connections 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2132480412 >> 10.20.193.21:0/2132480412 conn(0x7f01e40b2ef0 msgr2=0x7f01e40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2132480412 shutdown_connections 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2132480412 wait complete. 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 10 monclient: build_initial_monmap 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.847+0000 7f01eb9c8640 10 monclient: monmap: 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:31.859 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 librados: starting msgr at 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 librados: starting objecter 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 Processor -- start 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 -- start start 2026-02-25T15:07:31.860 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 librados: setting wanted keys 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 librados: calling monclient init 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient: init 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-c con 0x7f01e4157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-b con 0x7f01e4157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient(hunting): picked mon.noname-a con 0x7f01e4164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e41375a0 con 0x7f01e4164d00 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e415c980 con 0x7f01e4157b50 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e415cc60 con 0x7f01e4157780 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01eb9c8640 10 monclient(hunting): authenticate will time out at 3395.440632s 2026-02-25T15:07:31.861 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01e9f3e640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f01e4164d00 0x7f01e4146720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43444/0 (socket says 10.20.193.21:43444) 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.848+0000 7f01e9f3e640 1 -- 10.20.193.21:0/2732987676 learned_addr learned my addr 10.20.193.21:0/2732987676 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter ms_handle_connect 0x7f01e4164d00 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter ms_handle_connect 0x7f01e4157780 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter ms_handle_connect 0x7f01e4157b50 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348821569 0 0) 0x7f01e41375a0 con 0x7f01e4164d00 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.862 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 10 monclient(hunting): my global_id is 28254 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.849+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b4003610 con 0x7f01e4164d00 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578126371 0 0) 0x7f01e415cc60 con 0x7f01e4157780 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): my global_id is 30884 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01e41375a0 con 0x7f01e4157780 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561938698 0 0) 0x7f01e415c980 con 0x7f01e4157b50 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 10 monclient(hunting): my global_id is 29230 2026-02-25T15:07:31.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.850+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01e415cc60 con 0x7f01e4157b50 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1700693409 0 0) 0x7f01e41375a0 con 0x7f01e4157780 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01e415c980 con 0x7f01e4157780 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01d40030b0 con 0x7f01e4157780 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.864 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3497662722 0 0) 0x7f01b4003610 con 0x7f01e4164d00 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01e41375a0 con 0x7f01e4164d00 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01e0003690 con 0x7f01e4164d00 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.852+0000 7f01d1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.865 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3603638173 0 0) 0x7f01e415cc60 con 0x7f01e4157b50 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01b4003610 con 0x7f01e4157b50 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01d8003060 con 0x7f01e4157b50 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:31.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.853+0000 7f01d1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.867 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4229994560 0 0) 0x7f01e415c980 con 0x7f01e4157780 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 >> v1:10.20.193.31:6789/0 conn(0x7f01e4157b50 legacy=0x7f01e409ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 >> v1:10.20.193.21:6789/0 conn(0x7f01e4164d00 legacy=0x7f01e4146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 1 monclient: found mon.c 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e415cf40 con 0x7f01e4157780 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 5 monclient: authenticate success, global_id 30884 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _renew_subs 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01e415d220 con 0x7f01e4157780 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 client.30884.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _renew_subs 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f01e415da20 con 0x7f01e4157780 2026-02-25T15:07:31.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 1 librados: init done 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.854+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e40531e0 con 0x7f01e4157780 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01d40048d0 con 0x7f01e4157780 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f01d4004c20 con 0x7f01e4157780 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d1ffb640 10 monclient: dump: 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:31.872 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.860+0000 7f01d37fe640 4 set_mon_vals no callback set 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.863+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f01d401df60 con 0x7f01e4157780 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.863+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f01d4095ab0 con 0x7f01e4157780 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.863+0000 7f01d1ffb640 10 client.30884.objecter ms_dispatch2 0x7f01e4000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:31.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.863+0000 7f01d1ffb640 3 client.30884.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:31.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.863+0000 7f01d1ffb640 3 client.30884.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:31.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.864+0000 7f01e8f3c640 10 monclient: get_auth_request con 0x7f01b4079fa0 auth_method 0 2026-02-25T15:07:31.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.864+0000 7f01d1ffb640 20 client.30884.objecter dump_active .. 0 homeless 2026-02-25T15:07:31.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.864+0000 7f01d1ffb640 10 client.30884.objecter ms_handle_connect 0x7f01b4079fa0 2026-02-25T15:07:31.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.951+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f01e40531e0 con 0x7f01e4157780 2026-02-25T15:07:31.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.952+0000 7f01d1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:31.953 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:31.952+0000 7f01d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:32.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.058+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f01e4147650 con 0x7f01b4079fa0 2026-02-25T15:07:32.060 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.058+0000 7f01d1ffb640 1 -- 10.20.193.21:0/2732987676 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7f01e4147650 con 0x7f01b4079fa0 2026-02-25T15:07:32.060 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 13 to deep-scrub 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 10 librados: watch_flush enter 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 10 librados: watch_flush exit 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 20 client.30884.objecter shutdown clearing up homeless session... 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 10 client.30884.objecter successfully canceled tick 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 >> v1:10.20.193.72:6800/2463505645 conn(0x7f01b4079fa0 legacy=0x7f01b409a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.062 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 10 monclient: shutdown 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 >> v1:10.20.193.68:6789/0 conn(0x7f01e4157780 legacy=0x7f01e4136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 shutdown_connections 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 >> 10.20.193.21:0/2732987676 conn(0x7f01e40b2ef0 msgr2=0x7f01e4138560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 shutdown_connections 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 -- 10.20.193.21:0/2732987676 wait complete. 2026-02-25T15:07:32.063 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.059+0000 7f01eb9c8640 1 librados: shutdown 2026-02-25T15:07:32.071 INFO:tasks.ceph:Scrubbing osd.2 2026-02-25T15:07:32.071 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:32.140 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 10 monclient: get_monmap_and_config 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 10 monclient: monmap: 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:32.139187+0000 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:32.139187+0000 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.141 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.142 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 1 Processor -- start 2026-02-25T15:07:32.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 1 -- start start 2026-02-25T15:07:32.142 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.138+0000 7f5393d13640 10 monclient: init 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-c con 0x7f538c15e2a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-b con 0x7f538c059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-a con 0x7f538c1a5660 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c162df0 con 0x7f538c1a5660 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c1630d0 con 0x7f538c059e10 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c1633b0 con 0x7f538c15e2a0 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5393d13640 10 monclient(hunting): authenticate will time out at 3395.731494s 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5392289640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f538c1a5660 0x7f538c1c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43448/0 (socket says 10.20.193.21:43448) 2026-02-25T15:07:32.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.139+0000 7f5392289640 1 -- 10.20.193.21:0/392667605 learned_addr learned my addr 10.20.193.21:0/392667605 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679015487 0 0) 0x7f538c1633b0 con 0x7f538c15e2a0 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 10 monclient(hunting): my global_id is 30887 2026-02-25T15:07:32.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.168+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5374003610 con 0x7f538c15e2a0 2026-02-25T15:07:32.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3948224775 0 0) 0x7f5374003610 con 0x7f538c15e2a0 2026-02-25T15:07:32.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 >> v1:10.20.193.31:6789/0 conn(0x7f538c059e10 legacy=0x7f538c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 >> v1:10.20.193.21:6789/0 conn(0x7f538c1a5660 legacy=0x7f538c1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.174 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 monclient: found mon.noname-c 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c163690 con 0x7f538c15e2a0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f537c002df0 con 0x7f538c15e2a0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:32.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5390a86640 10 monclient: dump: 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5393d13640 5 monclient: authenticate success, global_id 30887 2026-02-25T15:07:32.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.169+0000 7f5393d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f537c003000 con 0x7f538c15e2a0 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 1 -- 10.20.193.21:0/392667605 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f537c003440 con 0x7f538c15e2a0 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5390a86640 10 monclient: dump: 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.177 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 4 set_mon_vals no callback set 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 10 monclient: shutdown 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 1 -- 10.20.193.21:0/392667605 >> v1:10.20.193.68:6789/0 conn(0x7f538c15e2a0 legacy=0x7f538c05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 1 -- 10.20.193.21:0/392667605 shutdown_connections 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.170+0000 7f5393d13640 1 -- 10.20.193.21:0/392667605 >> 10.20.193.21:0/392667605 conn(0x7f538c0b2f60 msgr2=0x7f538c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 -- 10.20.193.21:0/392667605 shutdown_connections 2026-02-25T15:07:32.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 -- 10.20.193.21:0/392667605 wait complete. 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 10 monclient: monmap: 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.179 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 librados: starting msgr at 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 librados: starting objecter 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 Processor -- start 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 -- start start 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 librados: setting wanted keys 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 1 librados: calling monclient init 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.171+0000 7f5393d13640 10 monclient: init 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-b con 0x7f538c059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-a con 0x7f538c15e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient(hunting): picked mon.noname-c con 0x7f538c1a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c0b0340 con 0x7f538c15e2a0 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c1299e0 con 0x7f538c059e10 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538c129cc0 con 0x7f538c1a5660 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.172+0000 7f5393d13640 10 monclient(hunting): authenticate will time out at 3395.764323s 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.173+0000 7f5392289640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f538c1a5660 0x7f538c190fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48100/0 (socket says 10.20.193.21:48100) 2026-02-25T15:07:32.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.173+0000 7f5392289640 1 -- 10.20.193.21:0/1412926373 learned_addr learned my addr 10.20.193.21:0/1412926373 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.173+0000 7f537a7fc640 10 client.?.objecter ms_handle_connect 0x7f538c1a5660 2026-02-25T15:07:32.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.173+0000 7f537a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2451272695 0 0) 0x7f538c129cc0 con 0x7f538c1a5660 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 10 monclient(hunting): my global_id is 30890 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.174+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f535c003610 con 0x7f538c1a5660 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 471410424 0 0) 0x7f535c003610 con 0x7f538c1a5660 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f538c129cc0 con 0x7f538c1a5660 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5388003310 con 0x7f538c1a5660 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:32.184 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.176+0000 7f537a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3745446640 0 0) 0x7f538c129cc0 con 0x7f538c1a5660 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 >> v1:10.20.193.31:6789/0 conn(0x7f538c059e10 legacy=0x7f538c11ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 >> v1:10.20.193.21:6789/0 conn(0x7f538c15e2a0 legacy=0x7f538c12ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 1 monclient: found mon.c 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c129fa0 con 0x7f538c1a5660 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f537a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 5 monclient: authenticate success, global_id 30890 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 monclient: _renew_subs 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f538c12a280 con 0x7f538c1a5660 2026-02-25T15:07:32.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 client.30890.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 monclient: _renew_subs 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f538c12a840 con 0x7f538c1a5660 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 1 librados: init done 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 client.30890.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 15 client.30890.objecter _session_command_op_assign -1 1 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 20 client.30890.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 client.30890.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.178+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f538c164730 con 0x7f538c1a5660 2026-02-25T15:07:32.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f538c164730 con 0x7f538c1a5660 2026-02-25T15:07:32.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.188 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5388004c50 con 0x7f538c1a5660 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537bfff640 4 set_mon_vals no callback set 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 10 monclient: dump: 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.189 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.190 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.190 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.186+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f5388004e30 con 0x7f538c1a5660 2026-02-25T15:07:32.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.187+0000 7f5391a88640 10 monclient: get_auth_request con 0x7f535c079dc0 auth_method 0 2026-02-25T15:07:32.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.187+0000 7f537a7fc640 10 client.30890.objecter ms_handle_connect 0x7f535c079dc0 2026-02-25T15:07:32.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f5388095eb0 con 0x7f538c1a5660 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 10 client.30890.objecter ms_dispatch2 0x7f538c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 3 client.30890.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 3 client.30890.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 10 client.30890.objecter checking command 1 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter _get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 15 client.30890.objecter _session_command_op_remove -1 1 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter _get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 15 client.30890.objecter _session_command_op_assign 2 1 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 4 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 10 client.30890.objecter _send_command 1 2026-02-25T15:07:32.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6812/3838375510 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f535c0c6420 con 0x7f535c0a4720 2026-02-25T15:07:32.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 20 client.30890.objecter dump_active .. 0 homeless 2026-02-25T15:07:32.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f538805e810 con 0x7f538c1a5660 2026-02-25T15:07:32.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f537a7fc640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:32.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.188+0000 7f5391287640 10 monclient: get_auth_request con 0x7f535c0a4720 auth_method 0 2026-02-25T15:07:32.193 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.189+0000 7f537a7fc640 10 client.30890.objecter ms_handle_connect 0x7f535c0a4720 2026-02-25T15:07:32.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.199+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== osd.2 v1:10.20.193.68:6812/3838375510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f535c0c6420 con 0x7f535c0a4720 2026-02-25T15:07:32.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.199+0000 7f537a7fc640 10 client.30890.objecter ms_dispatch2 0x7f538c000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:32.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.199+0000 7f537a7fc640 10 client.30890.objecter _finish_command 1 = system:0 2026-02-25T15:07:32.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.199+0000 7f537a7fc640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 4 2026-02-25T15:07:32.201 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.199+0000 7f537a7fc640 15 client.30890.objecter _session_command_op_remove 2 1 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 10 client.30890.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 15 client.30890.objecter _session_command_op_assign -1 2 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 20 client.30890.objecter _get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 20 client.30890.objecter _get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 15 client.30890.objecter _session_command_op_remove -1 2 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 20 client.30890.objecter get_session s=0x7f535c0a4070 osd=2 3 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 15 client.30890.objecter _session_command_op_assign 2 2 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 4 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 10 client.30890.objecter _send_command 2 2026-02-25T15:07:32.209 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.207+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 --> v1:10.20.193.68:6812/3838375510 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f538c164450 con 0x7f535c0a4720 2026-02-25T15:07:32.216 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.214+0000 7f537a7fc640 1 -- 10.20.193.21:0/1412926373 <== osd.2 v1:10.20.193.68:6812/3838375510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f538c164450 con 0x7f535c0a4720 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.214+0000 7f537a7fc640 10 client.30890.objecter ms_dispatch2 0x7f538c000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.214+0000 7f537a7fc640 10 client.30890.objecter _finish_command 2 = system:0 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.214+0000 7f537a7fc640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 4 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.214+0000 7f537a7fc640 15 client.30890.objecter _session_command_op_remove 2 2 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:32.217 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 10 librados: watch_flush enter 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 10 librados: watch_flush exit 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 10 client.30890.objecter close_session for osd.2 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 >> v1:10.20.193.68:6812/3838375510 conn(0x7f535c0a4720 legacy=0x7f535c0c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 20 client.30890.objecter put_session s=0x7f535c0a4070 osd=2 1 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 20 client.30890.objecter shutdown clearing up homeless session... 2026-02-25T15:07:32.219 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 10 client.30890.objecter successfully canceled tick 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 >> v1:10.20.193.72:6800/2463505645 conn(0x7f535c079dc0 legacy=0x7f535c09a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 10 monclient: shutdown 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 >> v1:10.20.193.68:6789/0 conn(0x7f538c1a5660 legacy=0x7f538c190fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5392289640 1 -- 10.20.193.21:0/1412926373 reap_dead start 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 shutdown_connections 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 >> 10.20.193.21:0/1412926373 conn(0x7f538c0b2f60 msgr2=0x7f538c191f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 shutdown_connections 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 -- 10.20.193.21:0/1412926373 wait complete. 2026-02-25T15:07:32.220 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.215+0000 7f5393d13640 1 librados: shutdown 2026-02-25T15:07:32.225 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-25T15:07:32.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.291+0000 7fda93355640 10 monclient: get_monmap_and_config 2026-02-25T15:07:32.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.291+0000 7fda93355640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.291+0000 7fda93355640 10 monclient: monmap: 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:32.292538+0000 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:32.292538+0000 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.294 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.296 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 1 Processor -- start 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 1 -- start start 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient: init 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient(hunting): picked mon.noname-c con 0x7fda8c15d070 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient(hunting): picked mon.noname-b con 0x7fda8c15d440 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient(hunting): picked mon.noname-a con 0x7fda8c166f60 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c164e60 con 0x7fda8c166f60 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c0b1790 con 0x7fda8c15d440 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c0b1a70 con 0x7fda8c15d070 2026-02-25T15:07:32.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.292+0000 7fda93355640 10 monclient(hunting): authenticate will time out at 3395.884932s 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.293+0000 7fda908c9640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fda8c15d440 0x7fda8c166850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48652/0 (socket says 10.20.193.21:48652) 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.293+0000 7fda908c9640 1 -- 10.20.193.21:0/3056236068 learned_addr learned my addr 10.20.193.21:0/3056236068 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113656172 0 0) 0x7fda8c0b1790 con 0x7fda8c15d440 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): my global_id is 29236 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda74003610 con 0x7fda8c15d440 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216199838 0 0) 0x7fda8c164e60 con 0x7fda8c166f60 2026-02-25T15:07:32.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): my global_id is 28260 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda8c0b1790 con 0x7fda8c166f60 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217628487 0 0) 0x7fda8c0b1a70 con 0x7fda8c15d070 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 10 monclient(hunting): my global_id is 30893 2026-02-25T15:07:32.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.294+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda8c164e60 con 0x7fda8c15d070 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2935319472 0 0) 0x7fda74003610 con 0x7fda8c15d440 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 >> v1:10.20.193.68:6789/0 conn(0x7fda8c15d070 legacy=0x7fda8c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 >> v1:10.20.193.21:6789/0 conn(0x7fda8c166f60 legacy=0x7fda8c0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 monclient: found mon.noname-b 2026-02-25T15:07:32.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c0b1d50 con 0x7fda8c15d440 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda80002df0 con 0x7fda8c15d440 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda7bfff640 10 monclient: dump: 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.308 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda93355640 5 monclient: authenticate success, global_id 29236 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.296+0000 7fda93355640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda80002fc0 con 0x7fda8c15d440 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 1 -- 10.20.193.21:0/3056236068 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda80003400 con 0x7fda8c15d440 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda7bfff640 10 monclient: dump: 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.310 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 4 set_mon_vals no callback set 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 10 monclient: shutdown 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 1 -- 10.20.193.21:0/3056236068 >> v1:10.20.193.31:6789/0 conn(0x7fda8c15d440 legacy=0x7fda8c166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 1 -- 10.20.193.21:0/3056236068 shutdown_connections 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 1 -- 10.20.193.21:0/3056236068 >> 10.20.193.21:0/3056236068 conn(0x7fda8c0b2ef0 msgr2=0x7fda8c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 1 -- 10.20.193.21:0/3056236068 shutdown_connections 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 1 -- 10.20.193.21:0/3056236068 wait complete. 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.297+0000 7fda93355640 10 monclient: monmap: 2026-02-25T15:07:32.311 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 librados: starting msgr at 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 librados: starting objecter 2026-02-25T15:07:32.312 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 Processor -- start 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 -- start start 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 librados: setting wanted keys 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 librados: calling monclient init 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient: init 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient(hunting): picked mon.noname-a con 0x7fda8c15d070 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient(hunting): picked mon.noname-b con 0x7fda8c15d440 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient(hunting): picked mon.noname-c con 0x7fda8c166f60 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c0aa570 con 0x7fda8c15d070 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c0aa850 con 0x7fda8c15d440 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda8c0aab30 con 0x7fda8c166f60 2026-02-25T15:07:32.313 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.298+0000 7fda93355640 10 monclient(hunting): authenticate will time out at 3395.890885s 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda910ca640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fda8c15d070 0x7fda8c0a6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43472/0 (socket says 10.20.193.21:43472) 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda910ca640 1 -- 10.20.193.21:0/2763268087 learned_addr learned my addr 10.20.193.21:0/2763268087 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda908c9640 1 --1- 10.20.193.21:0/2763268087 >> v1:10.20.193.31:6789/0 conn(0x7fda8c15d440 0x7fda8c0ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48668/0 (socket says 10.20.193.21:48668) 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda918cb640 1 --1- 10.20.193.21:0/2763268087 >> v1:10.20.193.68:6789/0 conn(0x7fda8c166f60 0x7fda8c15be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48108/0 (socket says 10.20.193.21:48108) 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter ms_handle_connect 0x7fda8c15d070 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter ms_handle_connect 0x7fda8c166f60 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter ms_handle_connect 0x7fda8c15d440 2026-02-25T15:07:32.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.299+0000 7fda79ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823290583 0 0) 0x7fda8c0aa570 con 0x7fda8c15d070 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): my global_id is 28263 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda5c003610 con 0x7fda8c15d070 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674197610 0 0) 0x7fda8c0aab30 con 0x7fda8c166f60 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): my global_id is 30896 2026-02-25T15:07:32.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda8c0aa570 con 0x7fda8c166f60 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192809455 0 0) 0x7fda8c0aa850 con 0x7fda8c15d440 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 10 monclient(hunting): my global_id is 29239 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.300+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda8c0aab30 con 0x7fda8c15d440 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1884416233 0 0) 0x7fda8c0aa570 con 0x7fda8c166f60 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda8c0aa850 con 0x7fda8c166f60 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda88003390 con 0x7fda8c166f60 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:32.316 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3418289198 0 0) 0x7fda8c0aab30 con 0x7fda8c15d440 2026-02-25T15:07:32.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda8c0aa570 con 0x7fda8c15d440 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda80003310 con 0x7fda8c15d440 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.318 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2124667360 0 0) 0x7fda5c003610 con 0x7fda8c15d070 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda8c0aab30 con 0x7fda8c15d070 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda7c003170 con 0x7fda8c15d070 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.302+0000 7fda79ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.319 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 785350469 0 0) 0x7fda8c0aa850 con 0x7fda8c166f60 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 >> v1:10.20.193.31:6789/0 conn(0x7fda8c15d440 legacy=0x7fda8c0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 >> v1:10.20.193.21:6789/0 conn(0x7fda8c15d070 legacy=0x7fda8c0a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 1 monclient: found mon.c 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.320 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c0aae10 con 0x7fda8c166f60 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 5 monclient: authenticate success, global_id 30896 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _renew_subs 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c0ab0f0 con 0x7fda8c166f60 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 client.30896.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _renew_subs 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda8c0aa1f0 con 0x7fda8c166f60 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 1 librados: init done 2026-02-25T15:07:32.321 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:32.322 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.304+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c05bf50 con 0x7fda8c166f60 2026-02-25T15:07:32.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda88003a80 con 0x7fda8c166f60 2026-02-25T15:07:32.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fda88003dd0 con 0x7fda8c166f60 2026-02-25T15:07:32.323 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda79ffb640 10 monclient: dump: 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.324 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.311+0000 7fda7b7fe640 4 set_mon_vals no callback set 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.312+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fda88003fb0 con 0x7fda8c166f60 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda910ca640 10 monclient: get_auth_request con 0x7fda5c07a0c0 auth_method 0 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fda88095d40 con 0x7fda8c166f60 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 10 client.30896.objecter ms_dispatch2 0x7fda8c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 3 client.30896.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 3 client.30896.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 20 client.30896.objecter dump_active .. 0 homeless 2026-02-25T15:07:32.325 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.313+0000 7fda79ffb640 10 client.30896.objecter ms_handle_connect 0x7fda5c07a0c0 2026-02-25T15:07:32.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.398+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fda8c05bf50 con 0x7fda8c166f60 2026-02-25T15:07:32.399 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.398+0000 7fda79ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.400 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.398+0000 7fda79ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:32.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.507+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fda8c0b1480 con 0x7fda5c07a0c0 2026-02-25T15:07:32.509 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.507+0000 7fda79ffb640 1 -- 10.20.193.21:0/2763268087 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fda8c0b1480 con 0x7fda5c07a0c0 2026-02-25T15:07:32.510 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 2 to deep-scrub 2026-02-25T15:07:32.511 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 10 librados: watch_flush enter 2026-02-25T15:07:32.511 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 10 librados: watch_flush exit 2026-02-25T15:07:32.511 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 20 client.30896.objecter shutdown clearing up homeless session... 2026-02-25T15:07:32.511 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 10 client.30896.objecter successfully canceled tick 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 >> v1:10.20.193.72:6800/2463505645 conn(0x7fda5c07a0c0 legacy=0x7fda5c09a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 10 monclient: shutdown 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 >> v1:10.20.193.68:6789/0 conn(0x7fda8c166f60 legacy=0x7fda8c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 shutdown_connections 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 >> 10.20.193.21:0/2763268087 conn(0x7fda8c0b2ef0 msgr2=0x7fda8c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 shutdown_connections 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 -- 10.20.193.21:0/2763268087 wait complete. 2026-02-25T15:07:32.512 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.509+0000 7fda93355640 1 librados: shutdown 2026-02-25T15:07:32.519 INFO:tasks.ceph:Scrubbing osd.6 2026-02-25T15:07:32.519 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:32.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 10 monclient: get_monmap_and_config 2026-02-25T15:07:32.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 10 monclient: monmap: 2026-02-25T15:07:32.589 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:32.587834+0000 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:32.587834+0000 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 1 Processor -- start 2026-02-25T15:07:32.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 1 -- start start 2026-02-25T15:07:32.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.587+0000 7f81b0413640 10 monclient: init 2026-02-25T15:07:32.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-a con 0x7f81a815e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-b con 0x7f81a8059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-c con 0x7f81a81a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a8162df0 con 0x7f81a815e2a0 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a81630d0 con 0x7f81a8059e10 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a81633b0 con 0x7f81a81a5660 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81b0413640 10 monclient(hunting): authenticate will time out at 3396.180186s 2026-02-25T15:07:32.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81ae188640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f81a815e2a0 0x7f81a805da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43480/0 (socket says 10.20.193.21:43480) 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.588+0000 7f81ae188640 1 -- 10.20.193.21:0/2628750976 learned_addr learned my addr 10.20.193.21:0/2628750976 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.589+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660151710 0 0) 0x7f81a8162df0 con 0x7f81a815e2a0 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): my global_id is 28266 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8190003610 con 0x7f81a815e2a0 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115748349 0 0) 0x7f81a81630d0 con 0x7f81a8059e10 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 10 monclient(hunting): my global_id is 29242 2026-02-25T15:07:32.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.590+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a8162df0 con 0x7f81a8059e10 2026-02-25T15:07:32.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414065392 0 0) 0x7f81a81633b0 con 0x7f81a81a5660 2026-02-25T15:07:32.600 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient(hunting): my global_id is 30899 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a81630d0 con 0x7f81a81a5660 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1049450805 0 0) 0x7f8190003610 con 0x7f81a815e2a0 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 >> v1:10.20.193.68:6789/0 conn(0x7f81a81a5660 legacy=0x7f81a81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 >> v1:10.20.193.31:6789/0 conn(0x7f81a8059e10 legacy=0x7f81a815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 monclient: found mon.noname-a 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.601 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a8163690 con 0x7f81a815e2a0 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8198002df0 con 0x7f81a815e2a0 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81ad186640 10 monclient: dump: 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.602 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81b0413640 5 monclient: authenticate success, global_id 28266 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.591+0000 7f81b0413640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8198002fc0 con 0x7f81a815e2a0 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 1 -- 10.20.193.21:0/2628750976 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8198003400 con 0x7f81a815e2a0 2026-02-25T15:07:32.603 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81b0413640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81b0413640 4 set_mon_vals no callback set 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81ad186640 10 monclient: dump: 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.604 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81b0413640 10 monclient: shutdown 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81b0413640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.592+0000 7f81b0413640 1 -- 10.20.193.21:0/2628750976 >> v1:10.20.193.21:6789/0 conn(0x7f81a815e2a0 legacy=0x7f81a805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 -- 10.20.193.21:0/2628750976 shutdown_connections 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 -- 10.20.193.21:0/2628750976 >> 10.20.193.21:0/2628750976 conn(0x7f81a80b2f60 msgr2=0x7f81a80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 -- 10.20.193.21:0/2628750976 shutdown_connections 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 -- 10.20.193.21:0/2628750976 wait complete. 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 10 monclient: monmap: 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.605 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 librados: starting msgr at 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 librados: starting objecter 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 Processor -- start 2026-02-25T15:07:32.606 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 -- start start 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 librados: setting wanted keys 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 1 librados: calling monclient init 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.593+0000 7f81b0413640 10 monclient: init 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-b con 0x7f81a8059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-a con 0x7f81a815e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient(hunting): picked mon.noname-c con 0x7f81a81a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a8193d00 con 0x7f81a815e2a0 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a8193f70 con 0x7f81a8059e10 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a8194250 con 0x7f81a81a5660 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.607 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81b0413640 10 monclient(hunting): authenticate will time out at 3396.186210s 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81ad987640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f81a815e2a0 0x7f81a811e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43490/0 (socket says 10.20.193.21:43490) 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f81ad987640 1 -- 10.20.193.21:0/1285683198 learned_addr learned my addr 10.20.193.21:0/1285683198 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter ms_handle_connect 0x7f81a815e2a0 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter ms_handle_connect 0x7f81a81a5660 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter ms_handle_connect 0x7f81a8059e10 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.594+0000 7f818effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604957130 0 0) 0x7f81a8194250 con 0x7f81a81a5660 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.608 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): my global_id is 30902 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8178003610 con 0x7f81a81a5660 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776507540 0 0) 0x7f81a8193d00 con 0x7f81a815e2a0 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): my global_id is 28269 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a8194250 con 0x7f81a815e2a0 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794015083 0 0) 0x7f81a8193f70 con 0x7f81a8059e10 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.609 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 10 monclient(hunting): my global_id is 29245 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.595+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a8193d00 con 0x7f81a8059e10 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3647368818 0 0) 0x7f81a8193d00 con 0x7f81a8059e10 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81a8193f70 con 0x7f81a8059e10 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8198003310 con 0x7f81a8059e10 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): dump: 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.610 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 887205429 0 0) 0x7f81a8194250 con 0x7f81a815e2a0 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81a8193d00 con 0x7f81a815e2a0 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f819c003020 con 0x7f81a815e2a0 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:32.611 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): dump: 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3523470164 0 0) 0x7f8178003610 con 0x7f81a81a5660 2026-02-25T15:07:32.612 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81a8194250 con 0x7f81a81a5660 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f81a40033d0 con 0x7f81a81a5660 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.598+0000 7f818effd640 10 monclient(hunting): dump: 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.613 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.614 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 465664932 0 0) 0x7f81a8193f70 con 0x7f81a8059e10 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 >> v1:10.20.193.68:6789/0 conn(0x7f81a81a5660 legacy=0x7f81a8164070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 >> v1:10.20.193.21:6789/0 conn(0x7f81a815e2a0 legacy=0x7f81a811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 1 monclient: found mon.b 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.617 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a8194530 con 0x7f81a8059e10 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f818effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 5 monclient: authenticate success, global_id 29245 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 10 monclient: _renew_subs 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f81a8194810 con 0x7f81a8059e10 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 10 client.29245.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 10 monclient: _renew_subs 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f81a8195010 con 0x7f81a8059e10 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.599+0000 7f81b0413640 1 librados: init done 2026-02-25T15:07:32.618 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 10 client.29245.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 15 client.29245.objecter _session_command_op_assign -1 1 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 20 client.29245.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 10 client.29245.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.600+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f81a81952f0 con 0x7f81a8059e10 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81a81952f0 con 0x7f81a8059e10 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f81980029a0 con 0x7f81a8059e10 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f81ac985640 4 set_mon_vals no callback set 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.607+0000 7f818effd640 10 monclient: dump: 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.619 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.608+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f819801dec0 con 0x7f81a8059e10 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f81ad987640 10 monclient: get_auth_request con 0x7f817807a0f0 auth_method 0 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 10 client.29245.objecter ms_handle_connect 0x7f817807a0f0 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f81980959d0 con 0x7f81a8059e10 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 10 client.29245.objecter ms_dispatch2 0x7f81a8000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 3 client.29245.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 3 client.29245.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:32.620 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 10 client.29245.objecter checking command 1 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter _get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 15 client.29245.objecter _session_command_op_remove -1 1 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter _get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 15 client.29245.objecter _session_command_op_assign 6 1 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 4 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 10 client.29245.objecter _send_command 1 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.68:6808/359632495 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8198002fc0 con 0x7f81780a4a50 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 20 client.29245.objecter dump_active .. 0 homeless 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f819805ea00 con 0x7f81a8059e10 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.609+0000 7f818effd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.610+0000 7f81ae989640 10 monclient: get_auth_request con 0x7f81780a4a50 auth_method 0 2026-02-25T15:07:32.621 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.611+0000 7f818effd640 10 client.29245.objecter ms_handle_connect 0x7f81780a4a50 2026-02-25T15:07:32.623 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.621+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== osd.6 v1:10.20.193.68:6808/359632495 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f8198002fc0 con 0x7f81780a4a50 2026-02-25T15:07:32.623 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.621+0000 7f818effd640 10 client.29245.objecter ms_dispatch2 0x7f81a8000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:32.623 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.621+0000 7f818effd640 10 client.29245.objecter _finish_command 1 = system:0 2026-02-25T15:07:32.623 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.621+0000 7f818effd640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 4 2026-02-25T15:07:32.623 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.621+0000 7f818effd640 15 client.29245.objecter _session_command_op_remove 6 1 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 10 client.29245.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 15 client.29245.objecter _session_command_op_assign -1 2 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 20 client.29245.objecter _get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 20 client.29245.objecter _get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.630 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 15 client.29245.objecter _session_command_op_remove -1 2 2026-02-25T15:07:32.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 20 client.29245.objecter get_session s=0x7f81780a43a0 osd=6 3 2026-02-25T15:07:32.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 15 client.29245.objecter _session_command_op_assign 6 2 2026-02-25T15:07:32.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 4 2026-02-25T15:07:32.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 10 client.29245.objecter _send_command 2 2026-02-25T15:07:32.631 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.628+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 --> v1:10.20.193.68:6808/359632495 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f81a8195e10 con 0x7f81780a4a50 2026-02-25T15:07:32.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f818effd640 1 -- 10.20.193.21:0/1285683198 <== osd.6 v1:10.20.193.68:6808/359632495 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f81a8195e10 con 0x7f81780a4a50 2026-02-25T15:07:32.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f818effd640 10 client.29245.objecter ms_dispatch2 0x7f81a8000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:32.645 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f818effd640 10 client.29245.objecter _finish_command 2 = system:0 2026-02-25T15:07:32.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f818effd640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 4 2026-02-25T15:07:32.646 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f818effd640 15 client.29245.objecter _session_command_op_remove 6 2 2026-02-25T15:07:32.646 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:32.646 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T15:07:32.646 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 10 librados: watch_flush enter 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 10 librados: watch_flush exit 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 10 client.29245.objecter close_session for osd.6 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 >> v1:10.20.193.68:6808/359632495 conn(0x7f81780a4a50 legacy=0x7f81780c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 20 client.29245.objecter put_session s=0x7f81780a43a0 osd=6 1 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 20 client.29245.objecter shutdown clearing up homeless session... 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 10 client.29245.objecter successfully canceled tick 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 >> v1:10.20.193.72:6800/2463505645 conn(0x7f817807a0f0 legacy=0x7f817809a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 10 monclient: shutdown 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.648 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 >> v1:10.20.193.31:6789/0 conn(0x7f81a8059e10 legacy=0x7f81a818fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81ae989640 1 -- 10.20.193.21:0/1285683198 reap_dead start 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 shutdown_connections 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.643+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 >> 10.20.193.21:0/1285683198 conn(0x7f81a80b2f60 msgr2=0x7f81a81a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.644+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 shutdown_connections 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.644+0000 7f81b0413640 1 -- 10.20.193.21:0/1285683198 wait complete. 2026-02-25T15:07:32.649 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.644+0000 7f81b0413640 1 librados: shutdown 2026-02-25T15:07:32.653 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-25T15:07:32.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.719+0000 7fee72973640 10 monclient: get_monmap_and_config 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.720+0000 7fee72973640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.720+0000 7fee72973640 10 monclient: monmap: 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:32.720733+0000 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:32.720733+0000 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.722 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.723 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.723 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.720+0000 7fee72973640 1 Processor -- start 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.720+0000 7fee72973640 1 -- start start 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.720+0000 7fee72973640 10 monclient: init 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient(hunting): picked mon.noname-a con 0x7fee6c157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient(hunting): picked mon.noname-b con 0x7fee6c157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient(hunting): picked mon.noname-c con 0x7fee6c164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c05de70 con 0x7fee6c157780 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c055b20 con 0x7fee6c157b50 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c055e00 con 0x7fee6c164d00 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee72973640 10 monclient(hunting): authenticate will time out at 3396.313081s 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee6bfff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fee6c157780 0x7fee6c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43496/0 (socket says 10.20.193.21:43496) 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.721+0000 7fee6bfff640 1 -- 10.20.193.21:0/3787478419 learned_addr learned my addr 10.20.193.21:0/3787478419 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748389037 0 0) 0x7fee6c05de70 con 0x7fee6c157780 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): my global_id is 28272 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee50003610 con 0x7fee6c157780 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367509218 0 0) 0x7fee6c055b20 con 0x7fee6c157b50 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 10 monclient(hunting): my global_id is 29248 2026-02-25T15:07:32.727 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.722+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c05de70 con 0x7fee6c157b50 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484798422 0 0) 0x7fee6c055e00 con 0x7fee6c164d00 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 10 monclient(hunting): my global_id is 30905 2026-02-25T15:07:32.728 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.723+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c055b20 con 0x7fee6c164d00 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3548049943 0 0) 0x7fee50003610 con 0x7fee6c157780 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 >> v1:10.20.193.68:6789/0 conn(0x7fee6c164d00 legacy=0x7fee6c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 >> v1:10.20.193.31:6789/0 conn(0x7fee6c157b50 legacy=0x7fee6c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 monclient: found mon.noname-a 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c0560e0 con 0x7fee6c157780 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee58002df0 con 0x7fee6c157780 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee6affd640 10 monclient: dump: 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.736 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee72973640 5 monclient: authenticate success, global_id 28272 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.724+0000 7fee72973640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee58002fc0 con 0x7fee6c157780 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 1 -- 10.20.193.21:0/3787478419 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee58003400 con 0x7fee6c157780 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee6affd640 10 monclient: dump: 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.737 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 4 set_mon_vals no callback set 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 10 monclient: shutdown 2026-02-25T15:07:32.738 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 1 -- 10.20.193.21:0/3787478419 >> v1:10.20.193.21:6789/0 conn(0x7fee6c157780 legacy=0x7fee6c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 1 -- 10.20.193.21:0/3787478419 shutdown_connections 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 1 -- 10.20.193.21:0/3787478419 >> 10.20.193.21:0/3787478419 conn(0x7fee6c0b2ef0 msgr2=0x7fee6c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 1 -- 10.20.193.21:0/3787478419 shutdown_connections 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 1 -- 10.20.193.21:0/3787478419 wait complete. 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 10 monclient: build_initial_monmap 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.725+0000 7fee72973640 10 monclient: monmap: 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:32.739 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 librados: starting msgr at 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 librados: starting objecter 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 Processor -- start 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 -- start start 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 librados: setting wanted keys 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 librados: calling monclient init 2026-02-25T15:07:32.740 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient: init 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient(hunting): picked mon.noname-b con 0x7fee6c157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient(hunting): picked mon.noname-c con 0x7fee6c157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient(hunting): picked mon.noname-a con 0x7fee6c164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c1325c0 con 0x7fee6c164d00 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c132860 con 0x7fee6c157780 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c132b40 con 0x7fee6c157b50 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.726+0000 7fee72973640 10 monclient(hunting): authenticate will time out at 3396.318646s 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee6bfff640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fee6c157780 0x7fee6c145480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48704/0 (socket says 10.20.193.21:48704) 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee6bfff640 1 -- 10.20.193.21:0/1730856368 learned_addr learned my addr 10.20.193.21:0/1730856368 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:32.741 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter ms_handle_connect 0x7fee6c164d00 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter ms_handle_connect 0x7fee6c157780 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter ms_handle_connect 0x7fee6c157b50 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.727+0000 7fee68ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151728808 0 0) 0x7fee6c1325c0 con 0x7fee6c164d00 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): my global_id is 28275 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee3c003610 con 0x7fee6c164d00 2026-02-25T15:07:32.742 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480965118 0 0) 0x7fee6c132860 con 0x7fee6c157780 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): my global_id is 29251 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c1325c0 con 0x7fee6c157780 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522484509 0 0) 0x7fee6c132b40 con 0x7fee6c157b50 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 10 monclient(hunting): my global_id is 30908 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.728+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee6c132860 con 0x7fee6c157b50 2026-02-25T15:07:32.743 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 234083176 0 0) 0x7fee3c003610 con 0x7fee6c164d00 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee6c132b40 con 0x7fee6c164d00 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee60003330 con 0x7fee6c164d00 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.744 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3496346077 0 0) 0x7fee6c1325c0 con 0x7fee6c157780 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee3c003610 con 0x7fee6c157780 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee58003310 con 0x7fee6c157780 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.730+0000 7fee68ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.745 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2025737047 0 0) 0x7fee6c132860 con 0x7fee6c157b50 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee6c1325c0 con 0x7fee6c157b50 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee5c003070 con 0x7fee6c157b50 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:32.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.731+0000 7fee68ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 779333563 0 0) 0x7fee6c132b40 con 0x7fee6c164d00 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 >> v1:10.20.193.68:6789/0 conn(0x7fee6c157b50 legacy=0x7fee6c058c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.747 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 >> v1:10.20.193.31:6789/0 conn(0x7fee6c157780 legacy=0x7fee6c145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 1 monclient: found mon.a 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c132e20 con 0x7fee6c164d00 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 5 monclient: authenticate success, global_id 28275 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _renew_subs 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c133100 con 0x7fee6c164d00 2026-02-25T15:07:32.748 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 client.28275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _renew_subs 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fee6c133900 con 0x7fee6c164d00 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 1 librados: init done 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:32.749 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.732+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee6c0531e0 con 0x7fee6c164d00 2026-02-25T15:07:32.826 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fee60003a80 con 0x7fee6c164d00 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fee60003dd0 con 0x7fee6c164d00 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee6a7fc640 4 set_mon_vals no callback set 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.824+0000 7fee68ff9640 10 monclient: dump: 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:32.827 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:32.828 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.825+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fee6001d2b0 con 0x7fee6c164d00 2026-02-25T15:07:32.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.825+0000 7fee6bfff640 10 monclient: get_auth_request con 0x7fee3c07a0f0 auth_method 0 2026-02-25T15:07:32.829 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.826+0000 7fee68ff9640 10 client.28275.objecter ms_handle_connect 0x7fee3c07a0f0 2026-02-25T15:07:32.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fee60094b00 con 0x7fee6c164d00 2026-02-25T15:07:32.830 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 10 client.28275.objecter ms_dispatch2 0x7fee6c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 3 client.28275.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 3 client.28275.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 20 client.28275.objecter dump_active .. 0 homeless 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fee6c0531e0 con 0x7fee6c164d00 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:32.831 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.828+0000 7fee68ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:32.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.934+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fee6c0b4d50 con 0x7fee3c07a0f0 2026-02-25T15:07:32.937 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.935+0000 7fee68ff9640 1 -- 10.20.193.21:0/1730856368 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7fee6c0b4d50 con 0x7fee3c07a0f0 2026-02-25T15:07:32.937 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 6 to deep-scrub 2026-02-25T15:07:32.938 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.935+0000 7fee72973640 10 librados: watch_flush enter 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.935+0000 7fee72973640 10 librados: watch_flush exit 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.935+0000 7fee72973640 20 client.28275.objecter shutdown clearing up homeless session... 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.935+0000 7fee72973640 10 client.28275.objecter successfully canceled tick 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 >> v1:10.20.193.72:6800/2463505645 conn(0x7fee3c07a0f0 legacy=0x7fee3c09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 10 monclient: shutdown 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 >> v1:10.20.193.21:6789/0 conn(0x7fee6c164d00 legacy=0x7fee6c144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 shutdown_connections 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 >> 10.20.193.21:0/1730856368 conn(0x7fee6c0b2ef0 msgr2=0x7fee6c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 shutdown_connections 2026-02-25T15:07:32.939 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 -- 10.20.193.21:0/1730856368 wait complete. 2026-02-25T15:07:32.940 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:32.936+0000 7fee72973640 1 librados: shutdown 2026-02-25T15:07:32.947 INFO:tasks.ceph:Scrubbing osd.10 2026-02-25T15:07:32.947 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:33.015 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.013+0000 7fd87951b640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.013+0000 7fd87951b640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.013+0000 7fd87951b640 10 monclient: monmap: 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.014715+0000 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.014715+0000 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.016 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.017 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.017 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.017 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.017 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.014+0000 7fd87951b640 1 Processor -- start 2026-02-25T15:07:33.019 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.014+0000 7fd87951b640 1 -- start start 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.014+0000 7fd87951b640 10 monclient: init 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-b con 0x7fd87415e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-a con 0x7fd874059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-c con 0x7fd8741a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd874162df0 con 0x7fd874059e10 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8741630d0 con 0x7fd87415e2a0 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8741633b0 con 0x7fd8741a5660 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.020 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd87951b640 10 monclient(hunting): authenticate will time out at 3396.607188s 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd8727fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fd874059e10 0x7fd87415ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43510/0 (socket says 10.20.193.21:43510) 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.015+0000 7fd8727fc640 1 -- 10.20.193.21:0/3579506863 learned_addr learned my addr 10.20.193.21:0/3579506863 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.016+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161216695 0 0) 0x7fd8741633b0 con 0x7fd8741a5660 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): my global_id is 30911 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd860003610 con 0x7fd8741a5660 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600944653 0 0) 0x7fd874162df0 con 0x7fd874059e10 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.021 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): my global_id is 28278 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8741633b0 con 0x7fd874059e10 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182917861 0 0) 0x7fd8741630d0 con 0x7fd87415e2a0 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 10 monclient(hunting): my global_id is 29254 2026-02-25T15:07:33.022 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.017+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd874162df0 con 0x7fd87415e2a0 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3880308263 0 0) 0x7fd860003610 con 0x7fd8741a5660 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 >> v1:10.20.193.31:6789/0 conn(0x7fd87415e2a0 legacy=0x7fd87405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 >> v1:10.20.193.21:6789/0 conn(0x7fd874059e10 legacy=0x7fd87415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 monclient: found mon.noname-c 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd874163690 con 0x7fd8741a5660 2026-02-25T15:07:33.028 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd864003170 con 0x7fd8741a5660 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd871ffb640 10 monclient: dump: 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.029 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd87951b640 5 monclient: authenticate success, global_id 30911 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.018+0000 7fd87951b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd864003340 con 0x7fd8741a5660 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 1 -- 10.20.193.21:0/3579506863 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd864003780 con 0x7fd8741a5660 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.030 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd871ffb640 10 monclient: dump: 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd87951b640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.031 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd87951b640 4 set_mon_vals no callback set 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd87951b640 10 monclient: shutdown 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd87951b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.019+0000 7fd87951b640 1 -- 10.20.193.21:0/3579506863 >> v1:10.20.193.68:6789/0 conn(0x7fd8741a5660 legacy=0x7fd8741c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 -- 10.20.193.21:0/3579506863 shutdown_connections 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 -- 10.20.193.21:0/3579506863 >> 10.20.193.21:0/3579506863 conn(0x7fd8740b2f60 msgr2=0x7fd8740b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 -- 10.20.193.21:0/3579506863 shutdown_connections 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 -- 10.20.193.21:0/3579506863 wait complete. 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 10 monclient: monmap: 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.032 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 librados: starting msgr at 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 librados: starting objecter 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 Processor -- start 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 -- start start 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 librados: setting wanted keys 2026-02-25T15:07:33.033 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 1 librados: calling monclient init 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.020+0000 7fd87951b640 10 monclient: init 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-c con 0x7fd874059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-a con 0x7fd87415e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient(hunting): picked mon.noname-b con 0x7fd8741a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87412afd0 con 0x7fd87415e2a0 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8740a78e0 con 0x7fd8741a5660 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8740a7bc0 con 0x7fd874059e10 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd87951b640 10 monclient(hunting): authenticate will time out at 3396.613286s 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8727fc640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fd87415e2a0 0x7fd8740a8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43522/0 (socket says 10.20.193.21:43522) 2026-02-25T15:07:33.034 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8727fc640 1 -- 10.20.193.21:0/964614865 learned_addr learned my addr 10.20.193.21:0/964614865 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter ms_handle_connect 0x7fd87415e2a0 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter ms_handle_connect 0x7fd8741a5660 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter ms_handle_connect 0x7fd874059e10 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.021+0000 7fd8537fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432047123 0 0) 0x7fd8740a78e0 con 0x7fd8741a5660 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): my global_id is 29257 2026-02-25T15:07:33.035 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd840003610 con 0x7fd8741a5660 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053301335 0 0) 0x7fd87412afd0 con 0x7fd87415e2a0 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): my global_id is 28281 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8740a78e0 con 0x7fd87415e2a0 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3389570451 0 0) 0x7fd8740a7bc0 con 0x7fd874059e10 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 10 monclient(hunting): my global_id is 30914 2026-02-25T15:07:33.036 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.022+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd87412afd0 con 0x7fd874059e10 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2578041511 0 0) 0x7fd87412afd0 con 0x7fd874059e10 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8740a7bc0 con 0x7fd874059e10 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd868003060 con 0x7fd874059e10 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): dump: 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.037 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2266452295 0 0) 0x7fd840003610 con 0x7fd8741a5660 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd87412afd0 con 0x7fd8741a5660 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd8640034f0 con 0x7fd8741a5660 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): dump: 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.038 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 374872924 0 0) 0x7fd8740a78e0 con 0x7fd87415e2a0 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd840003610 con 0x7fd87415e2a0 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd85c0030d0 con 0x7fd87415e2a0 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.039 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.025+0000 7fd8537fe640 10 monclient(hunting): dump: 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.040 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3535832113 0 0) 0x7fd840003610 con 0x7fd87415e2a0 2026-02-25T15:07:33.043 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 >> v1:10.20.193.68:6789/0 conn(0x7fd874059e10 legacy=0x7fd8741241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 >> v1:10.20.193.31:6789/0 conn(0x7fd8741a5660 legacy=0x7fd8740b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 1 monclient: found mon.a 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8740a7ea0 con 0x7fd87415e2a0 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd8537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 5 monclient: authenticate success, global_id 28281 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 10 monclient: _renew_subs 2026-02-25T15:07:33.044 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8740a8180 con 0x7fd87415e2a0 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 10 client.28281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 10 monclient: _renew_subs 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8740a9270 con 0x7fd87415e2a0 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.027+0000 7fd87951b640 1 librados: init done 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 10 client.28281.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 15 client.28281.objecter _session_command_op_assign -1 1 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 20 client.28281.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 10 client.28281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.045 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.028+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.21:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd87415fc20 con 0x7fd87415e2a0 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd87415fc20 con 0x7fd87415e2a0 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fd85c004a70 con 0x7fd87415e2a0 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8537fe640 10 monclient: dump: 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.046 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.036+0000 7fd8717fa640 4 set_mon_vals no callback set 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.037+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fd85c01df50 con 0x7fd87415e2a0 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.038+0000 7fd872ffd640 10 monclient: get_auth_request con 0x7fd84007a020 auth_method 0 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.038+0000 7fd8537fe640 10 client.28281.objecter ms_handle_connect 0x7fd84007a020 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fd85c095a50 con 0x7fd87415e2a0 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 10 client.28281.objecter ms_dispatch2 0x7fd874000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 3 client.28281.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 3 client.28281.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:33.047 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 10 client.28281.objecter checking command 1 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter _get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 15 client.28281.objecter _session_command_op_remove -1 1 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter _get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 15 client.28281.objecter _session_command_op_assign 10 1 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 4 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 10 client.28281.objecter _send_command 1 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.68:6800/3680498089 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd864002bf0 con 0x7fd8400a4980 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 20 client.28281.objecter dump_active .. 0 homeless 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fd85c05ea80 con 0x7fd87415e2a0 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8537fe640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.039+0000 7fd8737fe640 10 monclient: get_auth_request con 0x7fd8400a4980 auth_method 0 2026-02-25T15:07:33.048 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.040+0000 7fd8537fe640 10 client.28281.objecter ms_handle_connect 0x7fd8400a4980 2026-02-25T15:07:33.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.050+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== osd.10 v1:10.20.193.68:6800/3680498089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd864002bf0 con 0x7fd8400a4980 2026-02-25T15:07:33.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.050+0000 7fd8537fe640 10 client.28281.objecter ms_dispatch2 0x7fd874000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:33.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.050+0000 7fd8537fe640 10 client.28281.objecter _finish_command 1 = system:0 2026-02-25T15:07:33.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.050+0000 7fd8537fe640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 4 2026-02-25T15:07:33.052 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.050+0000 7fd8537fe640 15 client.28281.objecter _session_command_op_remove 10 1 2026-02-25T15:07:33.058 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.056+0000 7fd87951b640 10 client.28281.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 15 client.28281.objecter _session_command_op_assign -1 2 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 20 client.28281.objecter _get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 20 client.28281.objecter _get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 15 client.28281.objecter _session_command_op_remove -1 2 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 20 client.28281.objecter get_session s=0x7fd8400a42d0 osd=10 3 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 15 client.28281.objecter _session_command_op_assign 10 2 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 4 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 10 client.28281.objecter _send_command 2 2026-02-25T15:07:33.059 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.057+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 --> v1:10.20.193.68:6800/3680498089 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd87415f940 con 0x7fd8400a4980 2026-02-25T15:07:33.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd8537fe640 1 -- 10.20.193.21:0/964614865 <== osd.10 v1:10.20.193.68:6800/3680498089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd87415f940 con 0x7fd8400a4980 2026-02-25T15:07:33.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd8537fe640 10 client.28281.objecter ms_dispatch2 0x7fd874000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:33.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd8537fe640 10 client.28281.objecter _finish_command 2 = system:0 2026-02-25T15:07:33.066 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd8537fe640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 4 2026-02-25T15:07:33.067 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd8537fe640 15 client.28281.objecter _session_command_op_remove 10 2 2026-02-25T15:07:33.067 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:33.067 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:33.067 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 10 librados: watch_flush enter 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 10 librados: watch_flush exit 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 10 client.28281.objecter close_session for osd.10 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 >> v1:10.20.193.68:6800/3680498089 conn(0x7fd8400a4980 legacy=0x7fd8400c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 20 client.28281.objecter put_session s=0x7fd8400a42d0 osd=10 1 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 20 client.28281.objecter shutdown clearing up homeless session... 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.064+0000 7fd87951b640 10 client.28281.objecter successfully canceled tick 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 >> v1:10.20.193.72:6800/2463505645 conn(0x7fd84007a020 legacy=0x7fd84009a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 10 monclient: shutdown 2026-02-25T15:07:33.069 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 >> v1:10.20.193.21:6789/0 conn(0x7fd87415e2a0 legacy=0x7fd8740a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd8737fe640 1 -- 10.20.193.21:0/964614865 reap_dead start 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 shutdown_connections 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 >> 10.20.193.21:0/964614865 conn(0x7fd8740b2f60 msgr2=0x7fd874160140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 shutdown_connections 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 -- 10.20.193.21:0/964614865 wait complete. 2026-02-25T15:07:33.070 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.065+0000 7fd87951b640 1 librados: shutdown 2026-02-25T15:07:33.075 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 10 monclient: monmap: 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.142089+0000 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.142089+0000 2026-02-25T15:07:33.143 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.144 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.144 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.144 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.144 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.144 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 1 Processor -- start 2026-02-25T15:07:33.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 1 -- start start 2026-02-25T15:07:33.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.141+0000 7fc1d9a13640 10 monclient: init 2026-02-25T15:07:33.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-c con 0x7fc1d4157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-a con 0x7fc1d4157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-b con 0x7fc1d4164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d405de70 con 0x7fc1d4157b50 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d4055b20 con 0x7fc1d4164d00 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d4055e00 con 0x7fc1d4157780 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d9a13640 10 monclient(hunting): authenticate will time out at 3396.734337s 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d2ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fc1d4157780 0x7fc1d4056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48166/0 (socket says 10.20.193.21:48166) 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.142+0000 7fc1d2ffd640 1 -- 10.20.193.21:0/2030665651 learned_addr learned my addr 10.20.193.21:0/2030665651 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521311825 0 0) 0x7fc1d4055e00 con 0x7fc1d4157780 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): my global_id is 30917 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1c0003610 con 0x7fc1d4157780 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048287838 0 0) 0x7fc1d4055b20 con 0x7fc1d4164d00 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): my global_id is 29260 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d4055e00 con 0x7fc1d4164d00 2026-02-25T15:07:33.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010399124 0 0) 0x7fc1d405de70 con 0x7fc1d4157b50 2026-02-25T15:07:33.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 10 monclient(hunting): my global_id is 28284 2026-02-25T15:07:33.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.144+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d4055b20 con 0x7fc1d4157b50 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2829243340 0 0) 0x7fc1d4055e00 con 0x7fc1d4164d00 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 >> v1:10.20.193.68:6789/0 conn(0x7fc1d4157780 legacy=0x7fc1d4056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 >> v1:10.20.193.21:6789/0 conn(0x7fc1d4157b50 legacy=0x7fc1d41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 monclient: found mon.noname-b 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d40560e0 con 0x7fc1d4164d00 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1c40030a0 con 0x7fc1d4164d00 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d1ffb640 10 monclient: dump: 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.157 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d9a13640 5 monclient: authenticate success, global_id 29260 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.145+0000 7fc1d9a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1c4003270 con 0x7fc1d4164d00 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 1 -- 10.20.193.21:0/2030665651 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1c40036b0 con 0x7fc1d4164d00 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d1ffb640 10 monclient: dump: 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.158 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 4 set_mon_vals no callback set 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 10 monclient: shutdown 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 1 -- 10.20.193.21:0/2030665651 >> v1:10.20.193.31:6789/0 conn(0x7fc1d4164d00 legacy=0x7fc1d41c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.146+0000 7fc1d9a13640 1 -- 10.20.193.21:0/2030665651 shutdown_connections 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 -- 10.20.193.21:0/2030665651 >> 10.20.193.21:0/2030665651 conn(0x7fc1d40b2ef0 msgr2=0x7fc1d40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 -- 10.20.193.21:0/2030665651 shutdown_connections 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 -- 10.20.193.21:0/2030665651 wait complete. 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 10 monclient: monmap: 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.160 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 librados: starting msgr at 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 librados: starting objecter 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 Processor -- start 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 -- start start 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 librados: setting wanted keys 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 1 librados: calling monclient init 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.147+0000 7fc1d9a13640 10 monclient: init 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-a con 0x7fc1d4157780 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-b con 0x7fc1d4157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient(hunting): picked mon.noname-c con 0x7fc1d4164d00 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d405c2c0 con 0x7fc1d4157780 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d405c5a0 con 0x7fc1d4157b50 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1d405c880 con 0x7fc1d4164d00 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d9a13640 10 monclient(hunting): authenticate will time out at 3396.740114s 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d2ffd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fc1d4157780 0x7fc1d405b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43542/0 (socket says 10.20.193.21:43542) 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1d2ffd640 1 -- 10.20.193.21:0/4210377847 learned_addr learned my addr 10.20.193.21:0/4210377847 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter ms_handle_connect 0x7fc1d4157780 2026-02-25T15:07:33.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter ms_handle_connect 0x7fc1d4157b50 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter ms_handle_connect 0x7fc1d4164d00 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.148+0000 7fc1abfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303120316 0 0) 0x7fc1d405c2c0 con 0x7fc1d4157780 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): my global_id is 28287 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a4003610 con 0x7fc1d4157780 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283526830 0 0) 0x7fc1d405c5a0 con 0x7fc1d4157b50 2026-02-25T15:07:33.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): my global_id is 29263 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d405c2c0 con 0x7fc1d4157b50 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490649017 0 0) 0x7fc1d405c880 con 0x7fc1d4164d00 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 10 monclient(hunting): my global_id is 30920 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.149+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1d405c5a0 con 0x7fc1d4164d00 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 286893013 0 0) 0x7fc1a4003610 con 0x7fc1d4157780 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1d405c880 con 0x7fc1d4157780 2026-02-25T15:07:33.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1c80030f0 con 0x7fc1d4157780 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): dump: 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.165 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3167705101 0 0) 0x7fc1d405c2c0 con 0x7fc1d4157b50 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1a4003610 con 0x7fc1d4157b50 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1bc002fd0 con 0x7fc1d4157b50 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.151+0000 7fc1abfff640 10 monclient(hunting): dump: 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.166 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 560828268 0 0) 0x7fc1d405c5a0 con 0x7fc1d4164d00 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1d405c2c0 con 0x7fc1d4164d00 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1c40035c0 con 0x7fc1d4164d00 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.152+0000 7fc1abfff640 10 monclient(hunting): dump: 2026-02-25T15:07:33.167 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3367246545 0 0) 0x7fc1d405c880 con 0x7fc1d4157780 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 >> v1:10.20.193.68:6789/0 conn(0x7fc1d4164d00 legacy=0x7fc1d40ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 >> v1:10.20.193.31:6789/0 conn(0x7fc1d4157b50 legacy=0x7fc1d413b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 1 monclient: found mon.a 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d405cb60 con 0x7fc1d4157780 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 5 monclient: authenticate success, global_id 28287 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _renew_subs 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d405ce40 con 0x7fc1d4157780 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 client.28287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _renew_subs 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1d405c030 con 0x7fc1d4157780 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 1 librados: init done 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.153+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d4138400 con 0x7fc1d4157780 2026-02-25T15:07:33.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1c80048d0 con 0x7fc1d4157780 2026-02-25T15:07:33.244 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fc1c8004c20 con 0x7fc1d4157780 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1abfff640 10 monclient: dump: 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.245 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.246 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.246 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.246 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.246 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.246 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.242+0000 7fc1d17fa640 4 set_mon_vals no callback set 2026-02-25T15:07:33.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.243+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fc1c801e100 con 0x7fc1d4157780 2026-02-25T15:07:33.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.244+0000 7fc1d27fc640 10 monclient: get_auth_request con 0x7fc1a407a090 auth_method 0 2026-02-25T15:07:33.247 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.244+0000 7fc1abfff640 10 client.28287.objecter ms_handle_connect 0x7fc1a407a090 2026-02-25T15:07:33.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fc1c8095b80 con 0x7fc1d4157780 2026-02-25T15:07:33.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 10 client.28287.objecter ms_dispatch2 0x7fc1d4000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:33.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 3 client.28287.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:33.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 3 client.28287.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:33.248 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 20 client.28287.objecter dump_active .. 0 homeless 2026-02-25T15:07:33.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fc1c805f4e0 con 0x7fc1d4157780 2026-02-25T15:07:33.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.249 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.246+0000 7fc1abfff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:33.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.355+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fc1d4138120 con 0x7fc1a407a090 2026-02-25T15:07:33.357 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.355+0000 7fc1abfff640 1 -- 10.20.193.21:0/4210377847 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7fc1d4138120 con 0x7fc1a407a090 2026-02-25T15:07:33.358 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 10 to deep-scrub 2026-02-25T15:07:33.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 10 librados: watch_flush enter 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 10 librados: watch_flush exit 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 20 client.28287.objecter shutdown clearing up homeless session... 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 10 client.28287.objecter successfully canceled tick 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 >> v1:10.20.193.72:6800/2463505645 conn(0x7fc1a407a090 legacy=0x7fc1a409a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 10 monclient: shutdown 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 >> v1:10.20.193.21:6789/0 conn(0x7fc1d4157780 legacy=0x7fc1d405b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 shutdown_connections 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 >> 10.20.193.21:0/4210377847 conn(0x7fc1d40b2ef0 msgr2=0x7fc1d40577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 shutdown_connections 2026-02-25T15:07:33.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 -- 10.20.193.21:0/4210377847 wait complete. 2026-02-25T15:07:33.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.357+0000 7fc1d9a13640 1 librados: shutdown 2026-02-25T15:07:33.368 INFO:tasks.ceph:Scrubbing osd.14 2026-02-25T15:07:33.368 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.435+0000 7f1a90783640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.435+0000 7f1a90783640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.435+0000 7f1a90783640 10 monclient: monmap: 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.436589+0000 2026-02-25T15:07:33.438 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.436589+0000 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 1 Processor -- start 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 1 -- start start 2026-02-25T15:07:33.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient: init 2026-02-25T15:07:33.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:33.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-a con 0x7f1a8815e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-c con 0x7f1a88059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-b con 0x7f1a881a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a88162df0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a881630d0 con 0x7f1a881a5660 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a881633b0 con 0x7f1a88059e10 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.436+0000 7f1a90783640 10 monclient(hunting): authenticate will time out at 3397.028939s 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.437+0000 7f1a8ecf9640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f1a881a5660 0x7f1a881c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48730/0 (socket says 10.20.193.21:48730) 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.437+0000 7f1a8ecf9640 1 -- 10.20.193.21:0/1868494346 learned_addr learned my addr 10.20.193.21:0/1868494346 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.437+0000 7f1a8dcf7640 1 --1- 10.20.193.21:0/1868494346 >> v1:10.20.193.68:6789/0 conn(0x7f1a88059e10 0x7f1a8815ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48178/0 (socket says 10.20.193.21:48178) 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514137836 0 0) 0x7f1a881630d0 con 0x7f1a881a5660 2026-02-25T15:07:33.447 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): my global_id is 29266 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a70003610 con 0x7f1a881a5660 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821020394 0 0) 0x7f1a881633b0 con 0x7f1a88059e10 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 10 monclient(hunting): my global_id is 30923 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.438+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a881630d0 con 0x7f1a88059e10 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200124069 0 0) 0x7f1a88162df0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.448 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 10 monclient(hunting): my global_id is 28290 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.439+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a881633b0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2548757240 0 0) 0x7f1a70003610 con 0x7f1a881a5660 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 >> v1:10.20.193.68:6789/0 conn(0x7f1a88059e10 legacy=0x7f1a8815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 >> v1:10.20.193.21:6789/0 conn(0x7f1a8815e2a0 legacy=0x7f1a8805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 monclient: found mon.noname-b 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a88163690 con 0x7f1a881a5660 2026-02-25T15:07:33.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a840030a0 con 0x7f1a881a5660 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a8d4f6640 10 monclient: dump: 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.450 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a90783640 5 monclient: authenticate success, global_id 29266 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.440+0000 7f1a90783640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a84003270 con 0x7f1a881a5660 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 1 -- 10.20.193.21:0/1868494346 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a840036b0 con 0x7f1a881a5660 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a8d4f6640 10 monclient: dump: 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 4 set_mon_vals no callback set 2026-02-25T15:07:33.452 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 10 monclient: shutdown 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 1 -- 10.20.193.21:0/1868494346 >> v1:10.20.193.31:6789/0 conn(0x7f1a881a5660 legacy=0x7f1a881c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 1 -- 10.20.193.21:0/1868494346 shutdown_connections 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 1 -- 10.20.193.21:0/1868494346 >> 10.20.193.21:0/1868494346 conn(0x7f1a880b2f60 msgr2=0x7f1a880b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 1 -- 10.20.193.21:0/1868494346 shutdown_connections 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.441+0000 7f1a90783640 1 -- 10.20.193.21:0/1868494346 wait complete. 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient: monmap: 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.453 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 librados: starting msgr at 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 librados: starting objecter 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 Processor -- start 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 -- start start 2026-02-25T15:07:33.454 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 librados: setting wanted keys 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 librados: calling monclient init 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient: init 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-a con 0x7f1a88059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-b con 0x7f1a8815e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient(hunting): picked mon.noname-c con 0x7f1a881a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8812dae0 con 0x7f1a88059e10 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a88196d10 con 0x7f1a8815e2a0 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a88196ff0 con 0x7f1a881a5660 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.455 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.442+0000 7f1a90783640 10 monclient(hunting): authenticate will time out at 3397.034848s 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a8e4f8640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f1a88059e10 0x7f1a8812d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43562/0 (socket says 10.20.193.21:43562) 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a8e4f8640 1 -- 10.20.193.21:0/3966765879 learned_addr learned my addr 10.20.193.21:0/3966765879 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter ms_handle_connect 0x7f1a88059e10 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter ms_handle_connect 0x7f1a8815e2a0 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter ms_handle_connect 0x7f1a881a5660 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.443+0000 7f1a6effd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864231359 0 0) 0x7f1a8812dae0 con 0x7f1a88059e10 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.456 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): my global_id is 28293 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a58003610 con 0x7f1a88059e10 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388004774 0 0) 0x7f1a88196d10 con 0x7f1a8815e2a0 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): my global_id is 29269 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a8812dae0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335679784 0 0) 0x7f1a88196ff0 con 0x7f1a881a5660 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 10 monclient(hunting): my global_id is 30926 2026-02-25T15:07:33.457 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.444+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a88196d10 con 0x7f1a881a5660 2026-02-25T15:07:33.461 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2927135 0 0) 0x7f1a8812dae0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.461 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a88196ff0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.461 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a7c002ff0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.461 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): dump: 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.462 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2040520242 0 0) 0x7f1a58003610 con 0x7f1a88059e10 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a8812dae0 con 0x7f1a88059e10 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a78003170 con 0x7f1a88059e10 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): dump: 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.463 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506132754 0 0) 0x7f1a88196d10 con 0x7f1a881a5660 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a58003610 con 0x7f1a881a5660 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a84003420 con 0x7f1a881a5660 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.446+0000 7f1a6effd640 10 monclient(hunting): dump: 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.464 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1609684309 0 0) 0x7f1a88196ff0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 >> v1:10.20.193.68:6789/0 conn(0x7f1a881a5660 legacy=0x7f1a8812dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 >> v1:10.20.193.21:6789/0 conn(0x7f1a88059e10 legacy=0x7f1a8812d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.465 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 1 monclient: found mon.b 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a881972d0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 5 monclient: authenticate success, global_id 29269 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 monclient: _renew_subs 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a881975b0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 client.29269.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.466 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 monclient: _renew_subs 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a881984c0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 1 librados: init done 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 client.29269.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 15 client.29269.objecter _session_command_op_assign -1 1 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 20 client.29269.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 client.29269.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.448+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.31:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1a8805e110 con 0x7f1a8815e2a0 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a8805e110 con 0x7f1a8815e2a0 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.467 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1a7c0048d0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a6effd640 10 monclient: dump: 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.468 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.455+0000 7f1a8ccf5640 4 set_mon_vals no callback set 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.456+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f1a7c01ddb0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.457+0000 7f1a8e4f8640 10 monclient: get_auth_request con 0x7f1a58079fa0 auth_method 0 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.457+0000 7f1a6effd640 10 client.29269.objecter ms_handle_connect 0x7f1a58079fa0 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f1a7c0959c0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 10 client.29269.objecter ms_dispatch2 0x7f1a88000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 3 client.29269.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 3 client.29269.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 10 client.29269.objecter checking command 1 2026-02-25T15:07:33.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter _get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 15 client.29269.objecter _session_command_op_remove -1 1 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter _get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 15 client.29269.objecter _session_command_op_assign 14 1 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 4 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 10 client.29269.objecter _send_command 1 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.68:6804/3496291144 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a84002b20 con 0x7f1a580a4900 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 20 client.29269.objecter dump_active .. 0 homeless 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f1a7c05e9f0 con 0x7f1a8815e2a0 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a6effd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.458+0000 7f1a8ecf9640 10 monclient: get_auth_request con 0x7f1a580a4900 auth_method 0 2026-02-25T15:07:33.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.459+0000 7f1a6effd640 10 client.29269.objecter ms_handle_connect 0x7f1a580a4900 2026-02-25T15:07:33.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.468+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== osd.14 v1:10.20.193.68:6804/3496291144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f1a84002b20 con 0x7f1a580a4900 2026-02-25T15:07:33.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.468+0000 7f1a6effd640 10 client.29269.objecter ms_dispatch2 0x7f1a88000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:33.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.468+0000 7f1a6effd640 10 client.29269.objecter _finish_command 1 = system:0 2026-02-25T15:07:33.471 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.468+0000 7f1a6effd640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 4 2026-02-25T15:07:33.472 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.468+0000 7f1a6effd640 15 client.29269.objecter _session_command_op_remove 14 1 2026-02-25T15:07:33.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 10 client.29269.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:33.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 15 client.29269.objecter _session_command_op_assign -1 2 2026-02-25T15:07:33.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 20 client.29269.objecter _get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.477 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 20 client.29269.objecter _get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 15 client.29269.objecter _session_command_op_remove -1 2 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 20 client.29269.objecter get_session s=0x7f1a580a4250 osd=14 3 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 15 client.29269.objecter _session_command_op_assign 14 2 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 4 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 10 client.29269.objecter _send_command 2 2026-02-25T15:07:33.478 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.475+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 --> v1:10.20.193.68:6804/3496291144 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a880a9750 con 0x7f1a580a4900 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a6effd640 1 -- 10.20.193.21:0/3966765879 <== osd.14 v1:10.20.193.68:6804/3496291144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f1a880a9750 con 0x7f1a580a4900 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a6effd640 10 client.29269.objecter ms_dispatch2 0x7f1a88000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a6effd640 10 client.29269.objecter _finish_command 2 = system:0 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a6effd640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 4 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a6effd640 15 client.29269.objecter _session_command_op_remove 14 2 2026-02-25T15:07:33.485 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:33.486 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:33.486 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 10 librados: watch_flush enter 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 10 librados: watch_flush exit 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 10 client.29269.objecter close_session for osd.14 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 >> v1:10.20.193.68:6804/3496291144 conn(0x7f1a580a4900 legacy=0x7f1a580c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 20 client.29269.objecter put_session s=0x7f1a580a4250 osd=14 1 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 20 client.29269.objecter shutdown clearing up homeless session... 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 10 client.29269.objecter successfully canceled tick 2026-02-25T15:07:33.488 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 >> v1:10.20.193.72:6800/2463505645 conn(0x7f1a58079fa0 legacy=0x7f1a5809a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 10 monclient: shutdown 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 >> v1:10.20.193.31:6789/0 conn(0x7f1a8815e2a0 legacy=0x7f1a88197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a8ecf9640 1 -- 10.20.193.21:0/3966765879 reap_dead start 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 shutdown_connections 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 >> 10.20.193.21:0/3966765879 conn(0x7f1a880b2f60 msgr2=0x7f1a880b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 shutdown_connections 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 -- 10.20.193.21:0/3966765879 wait complete. 2026-02-25T15:07:33.489 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.483+0000 7f1a90783640 1 librados: shutdown 2026-02-25T15:07:33.492 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-25T15:07:33.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.557+0000 7f2e341e0640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.557+0000 7f2e341e0640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.557+0000 7f2e341e0640 10 monclient: monmap: 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.558613+0000 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.558613+0000 2026-02-25T15:07:33.562 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 1 Processor -- start 2026-02-25T15:07:33.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 1 -- start start 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient: init 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-c con 0x7f2e2c157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-a con 0x7f2e2c157b50 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-b con 0x7f2e2c164d00 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c05de70 con 0x7f2e2c157b50 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c055b20 con 0x7f2e2c164d00 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c055e00 con 0x7f2e2c157780 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.558+0000 7f2e341e0640 10 monclient(hunting): authenticate will time out at 3397.150883s 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.559+0000 7f2e31754640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f2e2c157b50 0x7f2e2c1645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43564/0 (socket says 10.20.193.21:43564) 2026-02-25T15:07:33.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.559+0000 7f2e31754640 1 -- 10.20.193.21:0/3834676246 learned_addr learned my addr 10.20.193.21:0/3834676246 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572948960 0 0) 0x7f2e2c05de70 con 0x7f2e2c157b50 2026-02-25T15:07:33.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): my global_id is 28296 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e14003610 con 0x7f2e2c157b50 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704307186 0 0) 0x7f2e2c055e00 con 0x7f2e2c157780 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 10 monclient(hunting): my global_id is 30929 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.560+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c05de70 con 0x7f2e2c157780 2026-02-25T15:07:33.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862562978 0 0) 0x7f2e2c055b20 con 0x7f2e2c164d00 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 10 monclient(hunting): my global_id is 29272 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.561+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c055e00 con 0x7f2e2c164d00 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2288908997 0 0) 0x7f2e14003610 con 0x7f2e2c157b50 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 >> v1:10.20.193.68:6789/0 conn(0x7f2e2c157780 legacy=0x7f2e2c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 >> v1:10.20.193.31:6789/0 conn(0x7f2e2c164d00 legacy=0x7f2e2c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 monclient: found mon.noname-a 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c0560e0 con 0x7f2e2c157b50 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.576 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e20002df0 con 0x7f2e2c157b50 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e30f53640 10 monclient: dump: 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.577 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e341e0640 5 monclient: authenticate success, global_id 28296 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.562+0000 7f2e341e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e20002fc0 con 0x7f2e2c157b50 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 1 -- 10.20.193.21:0/3834676246 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e20003400 con 0x7f2e2c157b50 2026-02-25T15:07:33.578 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 4 set_mon_vals no callback set 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e30f53640 10 monclient: dump: 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.579 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.580 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 10 monclient: shutdown 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 1 -- 10.20.193.21:0/3834676246 >> v1:10.20.193.21:6789/0 conn(0x7f2e2c157b50 legacy=0x7f2e2c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 1 -- 10.20.193.21:0/3834676246 shutdown_connections 2026-02-25T15:07:33.581 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 1 -- 10.20.193.21:0/3834676246 >> 10.20.193.21:0/3834676246 conn(0x7f2e2c0b2ef0 msgr2=0x7f2e2c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 1 -- 10.20.193.21:0/3834676246 shutdown_connections 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.563+0000 7f2e341e0640 1 -- 10.20.193.21:0/3834676246 wait complete. 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient: monmap: 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.582 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.583 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 librados: starting msgr at 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 librados: starting objecter 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.584 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 Processor -- start 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 -- start start 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 librados: setting wanted keys 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 librados: calling monclient init 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient: init 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.585 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:33.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-c con 0x7f2e2c157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-b con 0x7f2e2c157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient(hunting): picked mon.noname-a con 0x7f2e2c164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c1496d0 con 0x7f2e2c164d00 2026-02-25T15:07:33.586 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c13a3d0 con 0x7f2e2c157b50 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2c13a6b0 con 0x7f2e2c157780 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.564+0000 7f2e341e0640 10 monclient(hunting): authenticate will time out at 3397.156932s 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e32756640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f2e2c164d00 0x7f2e2c146530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43568/0 (socket says 10.20.193.21:43568) 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e32756640 1 -- 10.20.193.21:0/340897014 learned_addr learned my addr 10.20.193.21:0/340897014 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter ms_handle_connect 0x7f2e2c164d00 2026-02-25T15:07:33.587 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter ms_handle_connect 0x7f2e2c157b50 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter ms_handle_connect 0x7f2e2c157780 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.565+0000 7f2e1a7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235712813 0 0) 0x7f2e2c055e00 con 0x7f2e2c164d00 2026-02-25T15:07:33.588 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): my global_id is 28299 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dfc003610 con 0x7f2e2c164d00 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316083730 0 0) 0x7f2e2c13a3d0 con 0x7f2e2c157b50 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.589 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): my global_id is 29275 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c055e00 con 0x7f2e2c157b50 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003984086 0 0) 0x7f2e2c13a6b0 con 0x7f2e2c157780 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.590 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 10 monclient(hunting): my global_id is 30932 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.566+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e2c13a3d0 con 0x7f2e2c157780 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3225499423 0 0) 0x7f2dfc003610 con 0x7f2e2c164d00 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e2c13a6b0 con 0x7f2e2c164d00 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e280033c0 con 0x7f2e2c164d00 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.591 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.592 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.568+0000 7f2e1a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1718089949 0 0) 0x7f2e2c055e00 con 0x7f2e2c157b50 2026-02-25T15:07:33.593 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dfc003610 con 0x7f2e2c157b50 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e20003310 con 0x7f2e2c157b50 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.594 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1584260934 0 0) 0x7f2e2c13a3d0 con 0x7f2e2c157780 2026-02-25T15:07:33.595 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e2c055e00 con 0x7f2e2c157780 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e1c0030b0 con 0x7f2e2c157780 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.569+0000 7f2e1a7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3255234896 0 0) 0x7f2e2c13a6b0 con 0x7f2e2c164d00 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 >> v1:10.20.193.68:6789/0 conn(0x7f2e2c157780 legacy=0x7f2e2c136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.596 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 >> v1:10.20.193.31:6789/0 conn(0x7f2e2c157b50 legacy=0x7f2e2c145e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 1 monclient: found mon.a 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2c13a990 con 0x7f2e2c164d00 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 5 monclient: authenticate success, global_id 28299 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _renew_subs 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2c13ac70 con 0x7f2e2c164d00 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 client.28299.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _renew_subs 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.597 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e2c13b230 con 0x7f2e2c164d00 2026-02-25T15:07:33.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 1 librados: init done 2026-02-25T15:07:33.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:33.598 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.570+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2c0b5750 con 0x7f2e2c164d00 2026-02-25T15:07:33.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e28003a80 con 0x7f2e2c164d00 2026-02-25T15:07:33.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f2e28003e50 con 0x7f2e2c164d00 2026-02-25T15:07:33.663 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1bfff640 4 set_mon_vals no callback set 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.660+0000 7f2e1a7fc640 10 monclient: dump: 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.664 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.665 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.661+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f2e28004030 con 0x7f2e2c164d00 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.662+0000 7f2e31f55640 10 monclient: get_auth_request con 0x7f2dfc07a0f0 auth_method 0 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.662+0000 7f2e1a7fc640 10 client.28299.objecter ms_handle_connect 0x7f2dfc07a0f0 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f2e28095d80 con 0x7f2e2c164d00 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 10 client.28299.objecter ms_dispatch2 0x7f2e2c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 3 client.28299.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 3 client.28299.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:33.667 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 20 client.28299.objecter dump_active .. 0 homeless 2026-02-25T15:07:33.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f2e2c1496d0 con 0x7f2e2c164d00 2026-02-25T15:07:33.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.668 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.664+0000 7f2e1a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:33.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.768+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f2e2c0b5470 con 0x7f2dfc07a0f0 2026-02-25T15:07:33.770 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.768+0000 7f2e1a7fc640 1 -- 10.20.193.21:0/340897014 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7f2e2c0b5470 con 0x7f2dfc07a0f0 2026-02-25T15:07:33.770 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 14 to deep-scrub 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 10 librados: watch_flush enter 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 10 librados: watch_flush exit 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 20 client.28299.objecter shutdown clearing up homeless session... 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 10 client.28299.objecter successfully canceled tick 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 >> v1:10.20.193.72:6800/2463505645 conn(0x7f2dfc07a0f0 legacy=0x7f2dfc09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 10 monclient: shutdown 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 >> v1:10.20.193.21:6789/0 conn(0x7f2e2c164d00 legacy=0x7f2e2c146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 shutdown_connections 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 >> 10.20.193.21:0/340897014 conn(0x7f2e2c0b2ef0 msgr2=0x7f2e2c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 shutdown_connections 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.769+0000 7f2e341e0640 1 -- 10.20.193.21:0/340897014 wait complete. 2026-02-25T15:07:33.771 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.770+0000 7f2e341e0640 1 librados: shutdown 2026-02-25T15:07:33.779 INFO:tasks.ceph:Scrubbing osd.3 2026-02-25T15:07:33.779 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:33.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.846+0000 7f688e71a640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.846+0000 7f688e71a640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.846+0000 7f688e71a640 10 monclient: monmap: 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.847223+0000 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.847223+0000 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.849 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.850 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 1 Processor -- start 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 1 -- start start 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient: init 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-c con 0x7f6888159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-b con 0x7f6888165880 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-a con 0x7f6888056090 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688815a170 con 0x7f6888056090 2026-02-25T15:07:33.853 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880b4650 con 0x7f6888165880 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880b4930 con 0x7f6888159da0 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.847+0000 7f688e71a640 10 monclient(hunting): authenticate will time out at 3397.439762s 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.848+0000 7f688cc90640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f6888056090 0x7f68880b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43580/0 (socket says 10.20.193.21:43580) 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.848+0000 7f688cc90640 1 -- 10.20.193.21:0/142283242 learned_addr learned my addr 10.20.193.21:0/142283242 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512121 0 0) 0x7f68880b4930 con 0x7f6888159da0 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.854 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): my global_id is 30935 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f686c003610 con 0x7f6888159da0 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390011453 0 0) 0x7f688815a170 con 0x7f6888056090 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): my global_id is 28302 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68880b4930 con 0x7f6888056090 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063172975 0 0) 0x7f68880b4650 con 0x7f6888165880 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 10 monclient(hunting): my global_id is 29278 2026-02-25T15:07:33.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.849+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688815a170 con 0x7f6888165880 2026-02-25T15:07:33.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1321670526 0 0) 0x7f686c003610 con 0x7f6888159da0 2026-02-25T15:07:33.863 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 >> v1:10.20.193.31:6789/0 conn(0x7f6888165880 legacy=0x7f6888055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 >> v1:10.20.193.21:6789/0 conn(0x7f6888056090 legacy=0x7f68880b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 monclient: found mon.noname-c 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880b4c10 con 0x7f6888159da0 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6874002df0 con 0x7f6888159da0 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f6886ffd640 10 monclient: dump: 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.865 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f688e71a640 5 monclient: authenticate success, global_id 30935 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.851+0000 7f688e71a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6874002f90 con 0x7f6888159da0 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 1 -- 10.20.193.21:0/142283242 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f68740033d0 con 0x7f6888159da0 2026-02-25T15:07:33.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f6886ffd640 10 monclient: dump: 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.867 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 4 set_mon_vals no callback set 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 10 monclient: shutdown 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 1 -- 10.20.193.21:0/142283242 >> v1:10.20.193.68:6789/0 conn(0x7f6888159da0 legacy=0x7f6888165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 1 -- 10.20.193.21:0/142283242 shutdown_connections 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 1 -- 10.20.193.21:0/142283242 >> 10.20.193.21:0/142283242 conn(0x7f68880b78c0 msgr2=0x7f68880b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 1 -- 10.20.193.21:0/142283242 shutdown_connections 2026-02-25T15:07:33.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.852+0000 7f688e71a640 1 -- 10.20.193.21:0/142283242 wait complete. 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient: monmap: 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.869 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 librados: starting msgr at 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 librados: starting objecter 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 Processor -- start 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 -- start start 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 librados: setting wanted keys 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 librados: calling monclient init 2026-02-25T15:07:33.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient: init 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-a con 0x7f6888056090 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-c con 0x7f6888159da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient(hunting): picked mon.noname-b con 0x7f6888165880 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6888155f20 con 0x7f6888056090 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68881fb860 con 0x7f6888165880 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6888133fb0 con 0x7f6888159da0 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.853+0000 7f688e71a640 10 monclient(hunting): authenticate will time out at 3397.445981s 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f688cc90640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f6888165880 0x7f68881face0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48762/0 (socket says 10.20.193.21:48762) 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f688cc90640 1 -- 10.20.193.21:0/2240247846 learned_addr learned my addr 10.20.193.21:0/2240247846 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter ms_handle_connect 0x7f6888165880 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter ms_handle_connect 0x7f6888159da0 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter ms_handle_connect 0x7f6888056090 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.854+0000 7f6884ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562467456 0 0) 0x7f68881fb860 con 0x7f6888165880 2026-02-25T15:07:33.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): my global_id is 29281 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6858003610 con 0x7f6888165880 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937183228 0 0) 0x7f6888133fb0 con 0x7f6888159da0 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): my global_id is 30938 2026-02-25T15:07:33.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68881fb860 con 0x7f6888159da0 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368760544 0 0) 0x7f6888155f20 con 0x7f6888056090 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 10 monclient(hunting): my global_id is 28305 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.855+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6888133fb0 con 0x7f6888056090 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2506312758 0 0) 0x7f6858003610 con 0x7f6888165880 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6888155f20 con 0x7f6888165880 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f687c003540 con 0x7f6888165880 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.875 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1821459876 0 0) 0x7f68881fb860 con 0x7f6888159da0 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6858003610 con 0x7f6888159da0 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f6878002fb0 con 0x7f6888159da0 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.857+0000 7f6884ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.876 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3177518255 0 0) 0x7f6888133fb0 con 0x7f6888056090 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68881fb860 con 0x7f6888056090 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f68740032e0 con 0x7f6888056090 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.858+0000 7f6884ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:33.877 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3912046449 0 0) 0x7f6858003610 con 0x7f6888159da0 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 >> v1:10.20.193.31:6789/0 conn(0x7f6888165880 legacy=0x7f68881face0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.878 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 >> v1:10.20.193.21:6789/0 conn(0x7f6888056090 legacy=0x7f6888134d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 1 monclient: found mon.c 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888134290 con 0x7f6888159da0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f6884ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 5 monclient: authenticate success, global_id 30938 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 monclient: _renew_subs 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6888134570 con 0x7f6888159da0 2026-02-25T15:07:33.879 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 client.30938.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 monclient: _renew_subs 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f68881fbb40 con 0x7f6888159da0 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 1 librados: init done 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 client.30938.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 15 client.30938.objecter _session_command_op_assign -1 1 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 20 client.30938.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 client.30938.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.859+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6888056980 con 0x7f6888159da0 2026-02-25T15:07:33.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6888056980 con 0x7f6888159da0 2026-02-25T15:07:33.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f68780036e0 con 0x7f6888159da0 2026-02-25T15:07:33.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f6884ff9640 10 monclient: dump: 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.867+0000 7f68867fc640 4 set_mon_vals no callback set 2026-02-25T15:07:33.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.868+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f687801cbc0 con 0x7f6888159da0 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6887fff640 10 monclient: get_auth_request con 0x7f685807a130 auth_method 0 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 10 client.30938.objecter ms_handle_connect 0x7f685807a130 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f6878059740 con 0x7f6888159da0 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 10 client.30938.objecter ms_dispatch2 0x7f6888000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 3 client.30938.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 3 client.30938.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 10 client.30938.objecter checking command 1 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter _get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 15 client.30938.objecter _session_command_op_remove -1 1 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter _get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 15 client.30938.objecter _session_command_op_assign 3 1 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 4 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 10 client.30938.objecter _send_command 1 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.72:6805/464837367 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68580c6750 con 0x7f68580a4af0 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 20 client.30938.objecter dump_active .. 0 homeless 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7f6878059b20 con 0x7f6888159da0 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.869+0000 7f6884ff9640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.870+0000 7f688cc90640 10 monclient: get_auth_request con 0x7f68580a4af0 auth_method 0 2026-02-25T15:07:33.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.871+0000 7f6884ff9640 10 client.30938.objecter ms_handle_connect 0x7f68580a4af0 2026-02-25T15:07:33.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.881+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== osd.3 v1:10.20.193.72:6805/464837367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f68580c6750 con 0x7f68580a4af0 2026-02-25T15:07:33.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.881+0000 7f6884ff9640 10 client.30938.objecter ms_dispatch2 0x7f6888000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:33.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.881+0000 7f6884ff9640 10 client.30938.objecter _finish_command 1 = system:0 2026-02-25T15:07:33.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.881+0000 7f6884ff9640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 4 2026-02-25T15:07:33.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.881+0000 7f6884ff9640 15 client.30938.objecter _session_command_op_remove 3 1 2026-02-25T15:07:33.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 10 client.30938.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:33.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 15 client.30938.objecter _session_command_op_assign -1 2 2026-02-25T15:07:33.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 20 client.30938.objecter _get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.890 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 20 client.30938.objecter _get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 15 client.30938.objecter _session_command_op_remove -1 2 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 20 client.30938.objecter get_session s=0x7f68580a4440 osd=3 3 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 15 client.30938.objecter _session_command_op_assign 3 2 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 4 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 10 client.30938.objecter _send_command 2 2026-02-25T15:07:33.891 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.888+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 --> v1:10.20.193.72:6805/464837367 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68880531e0 con 0x7f68580a4af0 2026-02-25T15:07:33.897 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f6884ff9640 1 -- 10.20.193.21:0/2240247846 <== osd.3 v1:10.20.193.72:6805/464837367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f68880531e0 con 0x7f68580a4af0 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f6884ff9640 10 client.30938.objecter ms_dispatch2 0x7f6888000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f6884ff9640 10 client.30938.objecter _finish_command 2 = system:0 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f6884ff9640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 4 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f6884ff9640 15 client.30938.objecter _session_command_op_remove 3 2 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:33.898 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 10 librados: watch_flush enter 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 10 librados: watch_flush exit 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 10 client.30938.objecter close_session for osd.3 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 >> v1:10.20.193.72:6805/464837367 conn(0x7f68580a4af0 legacy=0x7f68580c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 20 client.30938.objecter put_session s=0x7f68580a4440 osd=3 1 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 20 client.30938.objecter shutdown clearing up homeless session... 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 10 client.30938.objecter successfully canceled tick 2026-02-25T15:07:33.899 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 >> v1:10.20.193.72:6800/2463505645 conn(0x7f685807a130 legacy=0x7f685809a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 10 monclient: shutdown 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 >> v1:10.20.193.68:6789/0 conn(0x7f6888159da0 legacy=0x7f6888155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688cc90640 1 -- 10.20.193.21:0/2240247846 reap_dead start 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 shutdown_connections 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 >> 10.20.193.21:0/2240247846 conn(0x7f68880b78c0 msgr2=0x7f68881385c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 shutdown_connections 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 -- 10.20.193.21:0/2240247846 wait complete. 2026-02-25T15:07:33.900 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.896+0000 7f688e71a640 1 librados: shutdown 2026-02-25T15:07:33.906 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-25T15:07:33.973 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.971+0000 7f5057cd0640 10 monclient: get_monmap_and_config 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.971+0000 7f5057cd0640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.971+0000 7f5057cd0640 10 monclient: monmap: 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:33.972578+0000 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:33.972578+0000 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.974 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.975 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.975 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 1 Processor -- start 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 1 -- start start 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient: init 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-b con 0x7f5050157780 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-c con 0x7f5050157b50 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-a con 0x7f5050164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.976 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505005de70 con 0x7f5050164d00 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050055b20 con 0x7f5050157780 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050055e00 con 0x7f5050157b50 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.972+0000 7f5057cd0640 10 monclient(hunting): authenticate will time out at 3397.564938s 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.973+0000 7f5055244640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f5050157b50 0x7f50501645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48250/0 (socket says 10.20.193.21:48250) 2026-02-25T15:07:33.977 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.973+0000 7f5055244640 1 -- 10.20.193.21:0/2697635240 learned_addr learned my addr 10.20.193.21:0/2697635240 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637597855 0 0) 0x7f5050055e00 con 0x7f5050157b50 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): my global_id is 30941 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5038003610 con 0x7f5050157b50 2026-02-25T15:07:33.979 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637375438 0 0) 0x7f505005de70 con 0x7f5050164d00 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 10 monclient(hunting): my global_id is 28308 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.974+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050055e00 con 0x7f5050164d00 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050210991 0 0) 0x7f5050055b20 con 0x7f5050157780 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 10 monclient(hunting): my global_id is 29284 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.975+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f505005de70 con 0x7f5050157780 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442296258 0 0) 0x7f5038003610 con 0x7f5050157b50 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 >> v1:10.20.193.31:6789/0 conn(0x7f5050157780 legacy=0x7f5050056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.980 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 >> v1:10.20.193.21:6789/0 conn(0x7f5050164d00 legacy=0x7f50501c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 monclient: found mon.noname-c 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50500560e0 con 0x7f5050157b50 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5044002df0 con 0x7f5050157b50 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5054a43640 10 monclient: dump: 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.981 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5057cd0640 5 monclient: authenticate success, global_id 30941 2026-02-25T15:07:33.982 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.976+0000 7f5057cd0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:33.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5044002fc0 con 0x7f5050157b50 2026-02-25T15:07:33.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:33.985 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 1 -- 10.20.193.21:0/2697635240 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5044003400 con 0x7f5050157b50 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5054a43640 10 monclient: dump: 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.986 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 4 set_mon_vals no callback set 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 10 monclient: shutdown 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 1 -- 10.20.193.21:0/2697635240 >> v1:10.20.193.68:6789/0 conn(0x7f5050157b50 legacy=0x7f50501645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 1 -- 10.20.193.21:0/2697635240 shutdown_connections 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 1 -- 10.20.193.21:0/2697635240 >> 10.20.193.21:0/2697635240 conn(0x7f50500b2ef0 msgr2=0x7f50500b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 1 -- 10.20.193.21:0/2697635240 shutdown_connections 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.980+0000 7f5057cd0640 1 -- 10.20.193.21:0/2697635240 wait complete. 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient: build_initial_monmap 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient: monmap: 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:33.987 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 librados: starting msgr at 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 librados: starting objecter 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 Processor -- start 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 -- start start 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 librados: setting wanted keys 2026-02-25T15:07:33.988 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 librados: calling monclient init 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient: init 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-c con 0x7f5050157780 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-b con 0x7f5050157b50 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient(hunting): picked mon.noname-a con 0x7f5050164d00 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050135b80 con 0x7f5050164d00 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50501371c0 con 0x7f5050157b50 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050135e40 con 0x7f5050157780 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.981+0000 7f5057cd0640 10 monclient(hunting): authenticate will time out at 3397.573791s 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f5056246640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f5050164d00 0x7f50500577c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43596/0 (socket says 10.20.193.21:43596) 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f5056246640 1 -- 10.20.193.21:0/2997110937 learned_addr learned my addr 10.20.193.21:0/2997110937 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:33.989 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter ms_handle_connect 0x7f5050157780 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter ms_handle_connect 0x7f5050164d00 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter ms_handle_connect 0x7f5050157b50 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.982+0000 7f503e7fc640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832562723 0 0) 0x7f5050135e40 con 0x7f5050157780 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): my global_id is 30944 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5020003610 con 0x7f5050157780 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696311880 0 0) 0x7f5050135b80 con 0x7f5050164d00 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.990 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): my global_id is 28311 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050135e40 con 0x7f5050164d00 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288190825 0 0) 0x7f50501371c0 con 0x7f5050157b50 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 10 monclient(hunting): my global_id is 29287 2026-02-25T15:07:33.991 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.983+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050135b80 con 0x7f5050157b50 2026-02-25T15:07:33.993 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 827129540 0 0) 0x7f5020003610 con 0x7f5050157780 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50501371c0 con 0x7f5050157780 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5040003060 con 0x7f5050157780 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.994 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2175800092 0 0) 0x7f5050135e40 con 0x7f5050164d00 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5020003610 con 0x7f5050164d00 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f504c0033d0 con 0x7f5050164d00 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.985+0000 7f503e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.995 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2923343036 0 0) 0x7f5050135b80 con 0x7f5050157b50 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5050135e40 con 0x7f5050157b50 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5044003310 con 0x7f5050157b50 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.986+0000 7f503e7fc640 10 monclient(hunting): dump: 2026-02-25T15:07:33.996 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1647523996 0 0) 0x7f50501371c0 con 0x7f5050157780 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 >> v1:10.20.193.31:6789/0 conn(0x7f5050157b50 legacy=0x7f5050147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 >> v1:10.20.193.21:6789/0 conn(0x7f5050164d00 legacy=0x7f50500577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:33.997 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 1 monclient: found mon.c 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5050136120 con 0x7f5050157780 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f503e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 5 monclient: authenticate success, global_id 30944 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _renew_subs 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5050136400 con 0x7f5050157780 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 client.30944.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _renew_subs 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.998 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50501369c0 con 0x7f5050157780 2026-02-25T15:07:33.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 1 librados: init done 2026-02-25T15:07:33.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:33.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:33.999 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:33.987+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f505005e250 con 0x7f5050157780 2026-02-25T15:07:34.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5040003700 con 0x7f5050157780 2026-02-25T15:07:34.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f5040003a50 con 0x7f5050157780 2026-02-25T15:07:34.078 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503ffff640 4 set_mon_vals no callback set 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.076+0000 7f503e7fc640 10 monclient: dump: 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.079 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.077+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f504001cf30 con 0x7f5050157780 2026-02-25T15:07:34.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.078+0000 7f5055244640 10 monclient: get_auth_request con 0x7f502007a080 auth_method 0 2026-02-25T15:07:34.080 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.078+0000 7f503e7fc640 10 client.30944.objecter ms_handle_connect 0x7f502007a080 2026-02-25T15:07:34.082 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.080+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f5040094910 con 0x7f5050157780 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.080+0000 7f503e7fc640 10 client.30944.objecter ms_dispatch2 0x7f5050000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.080+0000 7f503e7fc640 3 client.30944.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.080+0000 7f503e7fc640 3 client.30944.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.080+0000 7f503e7fc640 20 client.30944.objecter dump_active .. 0 homeless 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.082+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f505005e250 con 0x7f5050157780 2026-02-25T15:07:34.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.082+0000 7f503e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.082+0000 7f503e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:34.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.187+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5050138990 con 0x7f502007a080 2026-02-25T15:07:34.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.187+0000 7f503e7fc640 1 -- 10.20.193.21:0/2997110937 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f5050138990 con 0x7f502007a080 2026-02-25T15:07:34.190 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 3 to deep-scrub 2026-02-25T15:07:34.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 10 librados: watch_flush enter 2026-02-25T15:07:34.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 10 librados: watch_flush exit 2026-02-25T15:07:34.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 20 client.30944.objecter shutdown clearing up homeless session... 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 10 client.30944.objecter successfully canceled tick 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 >> v1:10.20.193.72:6800/2463505645 conn(0x7f502007a080 legacy=0x7f502009a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 10 monclient: shutdown 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 >> v1:10.20.193.68:6789/0 conn(0x7f5050157780 legacy=0x7f505015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 shutdown_connections 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 >> 10.20.193.21:0/2997110937 conn(0x7f50500b2ef0 msgr2=0x7f505013b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 shutdown_connections 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 -- 10.20.193.21:0/2997110937 wait complete. 2026-02-25T15:07:34.192 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.188+0000 7f5057cd0640 1 librados: shutdown 2026-02-25T15:07:34.199 INFO:tasks.ceph:Scrubbing osd.7 2026-02-25T15:07:34.199 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.268+0000 7fcab5133640 10 monclient: get_monmap_and_config 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.268+0000 7fcab5133640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.268+0000 7fcab5133640 10 monclient: monmap: 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:34.269372+0000 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:34.269372+0000 2026-02-25T15:07:34.271 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 1 Processor -- start 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 1 -- start start 2026-02-25T15:07:34.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient: init 2026-02-25T15:07:34.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-b con 0x7fcab015e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-a con 0x7fcab0059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-c con 0x7fcab01a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab0162df0 con 0x7fcab0059e10 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab01630d0 con 0x7fcab015e2a0 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab01633b0 con 0x7fcab01a5660 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.269+0000 7fcab5133640 10 monclient(hunting): authenticate will time out at 3397.861763s 2026-02-25T15:07:34.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.270+0000 7fcaae575640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7fcab0059e10 0x7fcab015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43604/0 (socket says 10.20.193.21:43604) 2026-02-25T15:07:34.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.270+0000 7fcaae575640 1 -- 10.20.193.21:0/3552465847 learned_addr learned my addr 10.20.193.21:0/3552465847 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446754455 0 0) 0x7fcab01633b0 con 0x7fcab01a5660 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 10 monclient(hunting): my global_id is 30947 2026-02-25T15:07:34.293 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.291+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca9c003610 con 0x7fcab01a5660 2026-02-25T15:07:34.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111484706 0 0) 0x7fca9c003610 con 0x7fcab01a5660 2026-02-25T15:07:34.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 >> v1:10.20.193.31:6789/0 conn(0x7fcab015e2a0 legacy=0x7fcab005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 >> v1:10.20.193.21:6789/0 conn(0x7fcab0059e10 legacy=0x7fcab015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.297 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 monclient: found mon.noname-c 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab0163690 con 0x7fcab01a5660 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcaa0003170 con 0x7fcab01a5660 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: dump: 2026-02-25T15:07:34.298 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcab5133640 5 monclient: authenticate success, global_id 30947 2026-02-25T15:07:34.299 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcab5133640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcaa0003380 con 0x7fcab01a5660 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 1 -- 10.20.193.21:0/3552465847 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcaa00037c0 con 0x7fcab01a5660 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcaadd74640 10 monclient: dump: 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.300 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcab5133640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.293+0000 7fcab5133640 4 set_mon_vals no callback set 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 10 monclient: shutdown 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 1 -- 10.20.193.21:0/3552465847 >> v1:10.20.193.68:6789/0 conn(0x7fcab01a5660 legacy=0x7fcab01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 1 -- 10.20.193.21:0/3552465847 shutdown_connections 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 1 -- 10.20.193.21:0/3552465847 >> 10.20.193.21:0/3552465847 conn(0x7fcab00b2f60 msgr2=0x7fcab00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 1 -- 10.20.193.21:0/3552465847 shutdown_connections 2026-02-25T15:07:34.301 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 1 -- 10.20.193.21:0/3552465847 wait complete. 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.294+0000 7fcab5133640 10 monclient: monmap: 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.302 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 librados: starting msgr at 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 librados: starting objecter 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 Processor -- start 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 -- start start 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 librados: setting wanted keys 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 librados: calling monclient init 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient: init 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-a con 0x7fcab0059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.303 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-b con 0x7fcab015e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient(hunting): picked mon.noname-c con 0x7fcab01a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab012a240 con 0x7fcab0059e10 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab012b0e0 con 0x7fcab015e2a0 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab012dce0 con 0x7fcab01a5660 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.304 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.295+0000 7fcab5133640 10 monclient(hunting): authenticate will time out at 3397.887574s 2026-02-25T15:07:34.306 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.296+0000 7fcaaf577640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fcab01a5660 0x7fcab0056b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48260/0 (socket says 10.20.193.21:48260) 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.296+0000 7fcaaf577640 1 -- 10.20.193.21:0/96924363 learned_addr learned my addr 10.20.193.21:0/96924363 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.297+0000 7fca8f7fe640 10 client.?.objecter ms_handle_connect 0x7fcab01a5660 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.297+0000 7fca8f7fe640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665042384 0 0) 0x7fcab012dce0 con 0x7fcab01a5660 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 10 monclient(hunting): my global_id is 30950 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.298+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca7c003610 con 0x7fcab01a5660 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3050547036 0 0) 0x7fca7c003610 con 0x7fcab01a5660 2026-02-25T15:07:34.307 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcab012dce0 con 0x7fcab01a5660 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcaa00036d0 con 0x7fcab01a5660 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 10 monclient(hunting): dump: 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.308 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.300+0000 7fca8f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3412961254 0 0) 0x7fcab012dce0 con 0x7fcab01a5660 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 >> v1:10.20.193.31:6789/0 conn(0x7fcab015e2a0 legacy=0x7fcab012a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 >> v1:10.20.193.21:6789/0 conn(0x7fcab0059e10 legacy=0x7fcab01a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 1 monclient: found mon.c 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab012dfc0 con 0x7fcab01a5660 2026-02-25T15:07:34.309 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fca8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 5 monclient: authenticate success, global_id 30950 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 10 monclient: _renew_subs 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcab012e2a0 con 0x7fcab01a5660 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 10 client.30950.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 10 monclient: _renew_subs 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcab012b600 con 0x7fcab01a5660 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.302+0000 7fcab5133640 1 librados: init done 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 10 client.30950.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.310 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 15 client.30950.objecter _session_command_op_assign -1 1 2026-02-25T15:07:34.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 20 client.30950.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:34.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 10 client.30950.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.311 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.303+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fcab0059740 con 0x7fcab01a5660 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcab0059740 con 0x7fcab01a5660 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fcaa0003330 con 0x7fcab01a5660 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fca8f7fe640 10 monclient: dump: 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.314 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.315 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.312+0000 7fcaad573640 4 set_mon_vals no callback set 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.313+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fcaa0003e10 con 0x7fcab01a5660 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.313+0000 7fcaaed76640 10 monclient: get_auth_request con 0x7fca7c079f70 auth_method 0 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 10 client.30950.objecter ms_handle_connect 0x7fca7c079f70 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fcaa0095e70 con 0x7fcab01a5660 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 10 client.30950.objecter ms_dispatch2 0x7fcab0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 3 client.30950.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 3 client.30950.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 10 client.30950.objecter checking command 1 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter _get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.317 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 15 client.30950.objecter _session_command_op_remove -1 1 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter _get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 15 client.30950.objecter _session_command_op_assign 7 1 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 4 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 10 client.30950.objecter _send_command 1 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.72:6813/85233281 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca7c0c6530 con 0x7fca7c0a48d0 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 20 client.30950.objecter dump_active .. 0 homeless 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7fcaa005eea0 con 0x7fcab01a5660 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.314+0000 7fca8f7fe640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:34.318 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.315+0000 7fcaae575640 10 monclient: get_auth_request con 0x7fca7c0a48d0 auth_method 0 2026-02-25T15:07:34.319 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.316+0000 7fca8f7fe640 10 client.30950.objecter ms_handle_connect 0x7fca7c0a48d0 2026-02-25T15:07:34.327 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.326+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== osd.7 v1:10.20.193.72:6813/85233281 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fca7c0c6530 con 0x7fca7c0a48d0 2026-02-25T15:07:34.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.326+0000 7fca8f7fe640 10 client.30950.objecter ms_dispatch2 0x7fcab0000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:34.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.326+0000 7fca8f7fe640 10 client.30950.objecter _finish_command 1 = system:0 2026-02-25T15:07:34.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.326+0000 7fca8f7fe640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 4 2026-02-25T15:07:34.328 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.326+0000 7fca8f7fe640 15 client.30950.objecter _session_command_op_remove 7 1 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 10 client.30950.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 15 client.30950.objecter _session_command_op_assign -1 2 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 20 client.30950.objecter _get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 20 client.30950.objecter _get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 15 client.30950.objecter _session_command_op_remove -1 2 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 20 client.30950.objecter get_session s=0x7fca7c0a4220 osd=7 3 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 15 client.30950.objecter _session_command_op_assign 7 2 2026-02-25T15:07:34.336 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 4 2026-02-25T15:07:34.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 10 client.30950.objecter _send_command 2 2026-02-25T15:07:34.337 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.334+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 --> v1:10.20.193.72:6813/85233281 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcab0059460 con 0x7fca7c0a48d0 2026-02-25T15:07:34.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.341+0000 7fca8f7fe640 1 -- 10.20.193.21:0/96924363 <== osd.7 v1:10.20.193.72:6813/85233281 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fcab0059460 con 0x7fca7c0a48d0 2026-02-25T15:07:34.343 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.341+0000 7fca8f7fe640 10 client.30950.objecter ms_dispatch2 0x7fcab0000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.341+0000 7fca8f7fe640 10 client.30950.objecter _finish_command 2 = system:0 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.341+0000 7fca8f7fe640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 4 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.341+0000 7fca8f7fe640 15 client.30950.objecter _session_command_op_remove 7 2 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:34.344 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 10 librados: watch_flush enter 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 10 librados: watch_flush exit 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 10 client.30950.objecter close_session for osd.7 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 >> v1:10.20.193.72:6813/85233281 conn(0x7fca7c0a48d0 legacy=0x7fca7c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 20 client.30950.objecter put_session s=0x7fca7c0a4220 osd=7 1 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 20 client.30950.objecter shutdown clearing up homeless session... 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 10 client.30950.objecter successfully canceled tick 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 >> v1:10.20.193.72:6800/2463505645 conn(0x7fca7c079f70 legacy=0x7fca7c09a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 10 monclient: shutdown 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.346 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 >> v1:10.20.193.68:6789/0 conn(0x7fcab01a5660 legacy=0x7fcab0056b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcaaf577640 1 -- 10.20.193.21:0/96924363 reap_dead start 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 shutdown_connections 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 >> 10.20.193.21:0/96924363 conn(0x7fcab00b2f60 msgr2=0x7fcab015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 shutdown_connections 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 -- 10.20.193.21:0/96924363 wait complete. 2026-02-25T15:07:34.347 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.342+0000 7fcab5133640 1 librados: shutdown 2026-02-25T15:07:34.353 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-25T15:07:34.422 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.420+0000 7f8b10e30640 10 monclient: get_monmap_and_config 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.421+0000 7f8b10e30640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.421+0000 7f8b10e30640 10 monclient: monmap: 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:34.421731+0000 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:34.421731+0000 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.423 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.424 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.424 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.424 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.421+0000 7f8b10e30640 1 Processor -- start 2026-02-25T15:07:34.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.421+0000 7f8b10e30640 1 -- start start 2026-02-25T15:07:34.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.421+0000 7f8b10e30640 10 monclient: init 2026-02-25T15:07:34.426 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-c con 0x7f8b0c159710 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-b con 0x7f8b0c159ae0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-a con 0x7f8b0c164f60 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0b3fd0 con 0x7f8b0c164f60 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0b42b0 con 0x7f8b0c159ae0 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0b4590 con 0x7f8b0c159710 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b10e30640 10 monclient(hunting): authenticate will time out at 3398.014301s 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b0affd640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7f8b0c159ae0 0x7f8b0c164850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48802/0 (socket says 10.20.193.21:48802) 2026-02-25T15:07:34.427 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.422+0000 7f8b0affd640 1 -- 10.20.193.21:0/4167413660 learned_addr learned my addr 10.20.193.21:0/4167413660 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530716923 0 0) 0x7f8b0c0b42b0 con 0x7f8b0c159ae0 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): my global_id is 29293 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af0003610 con 0x7f8b0c159ae0 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655968295 0 0) 0x7f8b0c0b4590 con 0x7f8b0c159710 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.428 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): my global_id is 30953 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c0b42b0 con 0x7f8b0c159710 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862031303 0 0) 0x7f8b0c0b3fd0 con 0x7f8b0c164f60 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 10 monclient(hunting): my global_id is 28317 2026-02-25T15:07:34.429 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.424+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c0b4590 con 0x7f8b0c164f60 2026-02-25T15:07:34.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3982322693 0 0) 0x7f8af0003610 con 0x7f8b0c159ae0 2026-02-25T15:07:34.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 >> v1:10.20.193.68:6789/0 conn(0x7f8b0c159710 legacy=0x7f8b0c0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 >> v1:10.20.193.21:6789/0 conn(0x7f8b0c164f60 legacy=0x7f8b0c057300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 monclient: found mon.noname-b 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c0b4870 con 0x7f8b0c159ae0 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.435 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8afc002d20 con 0x7f8b0c159ae0 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b0a7fc640 10 monclient: dump: 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.436 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b10e30640 5 monclient: authenticate success, global_id 29293 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.425+0000 7f8b10e30640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8afc002ef0 con 0x7f8b0c159ae0 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 1 -- 10.20.193.21:0/4167413660 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8afc003330 con 0x7f8b0c159ae0 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b0a7fc640 10 monclient: dump: 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.437 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 4 set_mon_vals no callback set 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 10 monclient: shutdown 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 1 -- 10.20.193.21:0/4167413660 >> v1:10.20.193.31:6789/0 conn(0x7f8b0c159ae0 legacy=0x7f8b0c164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.438 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 1 -- 10.20.193.21:0/4167413660 shutdown_connections 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 1 -- 10.20.193.21:0/4167413660 >> 10.20.193.21:0/4167413660 conn(0x7f8b0c0b79b0 msgr2=0x7f8b0c0b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 1 -- 10.20.193.21:0/4167413660 shutdown_connections 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.426+0000 7f8b10e30640 1 -- 10.20.193.21:0/4167413660 wait complete. 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient: monmap: 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.439 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 librados: starting msgr at 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 librados: starting objecter 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 Processor -- start 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 -- start start 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 librados: setting wanted keys 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 librados: calling monclient init 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient: init 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.440 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-a con 0x7f8b0c159710 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-b con 0x7f8b0c159ae0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient(hunting): picked mon.noname-c con 0x7f8b0c164f60 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c0b6c10 con 0x7f8b0c159710 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c140a40 con 0x7f8b0c159ae0 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0c140d20 con 0x7f8b0c164f60 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.427+0000 7f8b10e30640 10 monclient(hunting): authenticate will time out at 3398.019889s 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8b0b7fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f8b0c159710 0x7f8b0c0b6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43630/0 (socket says 10.20.193.21:43630) 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8b0b7fe640 1 -- 10.20.193.21:0/2613527953 learned_addr learned my addr 10.20.193.21:0/2613527953 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter ms_handle_connect 0x7f8b0c159710 2026-02-25T15:07:34.441 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter ms_handle_connect 0x7f8b0c159ae0 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter ms_handle_connect 0x7f8b0c164f60 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.428+0000 7f8ae7fff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285339097 0 0) 0x7f8b0c0b6c10 con 0x7f8b0c159710 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): my global_id is 28320 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003610 con 0x7f8b0c159710 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072396337 0 0) 0x7f8b0c140a40 con 0x7f8b0c159ae0 2026-02-25T15:07:34.442 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): my global_id is 29296 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c0b6c10 con 0x7f8b0c159ae0 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918732429 0 0) 0x7f8b0c140d20 con 0x7f8b0c164f60 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 10 monclient(hunting): my global_id is 30956 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.429+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b0c140a40 con 0x7f8b0c164f60 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2983110508 0 0) 0x7f8adc003610 con 0x7f8b0c159710 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b0c140d20 con 0x7f8b0c159710 2026-02-25T15:07:34.443 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8af8003190 con 0x7f8b0c159710 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.444 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.431+0000 7f8ae7fff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3692335194 0 0) 0x7f8b0c0b6c10 con 0x7f8b0c159ae0 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8adc003610 con 0x7f8b0c159ae0 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8afc003240 con 0x7f8b0c159ae0 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.445 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3027283635 0 0) 0x7f8b0c140a40 con 0x7f8b0c164f60 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b0c0b6c10 con 0x7f8b0c164f60 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8b00003330 con 0x7f8b0c164f60 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.432+0000 7f8ae7fff640 10 monclient(hunting): dump: 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.446 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.447 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4218037865 0 0) 0x7f8b0c140d20 con 0x7f8b0c159710 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 >> v1:10.20.193.68:6789/0 conn(0x7f8b0c164f60 legacy=0x7f8b0c117b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 >> v1:10.20.193.31:6789/0 conn(0x7f8b0c159ae0 legacy=0x7f8b0c13d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 1 monclient: found mon.a 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:34.449 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0c141000 con 0x7f8b0c159710 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8ae7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 5 monclient: authenticate success, global_id 28320 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 10 monclient: _renew_subs 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0c12e9f0 con 0x7f8b0c159710 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 10 client.28320.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 10 monclient: _renew_subs 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8b0c12fb10 con 0x7f8b0c159710 2026-02-25T15:07:34.450 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.433+0000 7f8b10e30640 1 librados: init done 2026-02-25T15:07:34.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.434+0000 7f8b10e30640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.434+0000 7f8b10e30640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.434+0000 7f8b10e30640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.21:6789/0 2026-02-25T15:07:34.451 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.434+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.21:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b0c12e7e0 con 0x7f8b0c159710 2026-02-25T15:07:34.525 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8af80034e0 con 0x7f8b0c159710 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f8af8003b50 con 0x7f8b0c159710 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8ae7fff640 10 monclient: dump: 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.526 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.527 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.523+0000 7f8b09ffb640 4 set_mon_vals no callback set 2026-02-25T15:07:34.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.524+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f8af8003d30 con 0x7f8b0c159710 2026-02-25T15:07:34.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.525+0000 7f8b0affd640 10 monclient: get_auth_request con 0x7f8adc07a040 auth_method 0 2026-02-25T15:07:34.528 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.525+0000 7f8ae7fff640 10 client.28320.objecter ms_handle_connect 0x7f8adc07a040 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f8af8095b50 con 0x7f8b0c159710 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 10 client.28320.objecter ms_dispatch2 0x7f8b0c000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 3 client.28320.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 3 client.28320.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 20 client.28320.objecter dump_active .. 0 homeless 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mon.0 v1:10.20.193.21:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f8af805f4b0 con 0x7f8b0c159710 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.529 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.526+0000 7f8ae7fff640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:34.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.631+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f8b0c156660 con 0x7f8adc07a040 2026-02-25T15:07:34.633 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.631+0000 7f8ae7fff640 1 -- 10.20.193.21:0/2613527953 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f8b0c156660 con 0x7f8adc07a040 2026-02-25T15:07:34.633 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 7 to deep-scrub 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 10 librados: watch_flush enter 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 10 librados: watch_flush exit 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 20 client.28320.objecter shutdown clearing up homeless session... 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 10 client.28320.objecter successfully canceled tick 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 >> v1:10.20.193.72:6800/2463505645 conn(0x7f8adc07a040 legacy=0x7f8adc09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.635 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 10 monclient: shutdown 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 >> v1:10.20.193.21:6789/0 conn(0x7f8b0c159710 legacy=0x7f8b0c0b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 shutdown_connections 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 >> 10.20.193.21:0/2613527953 conn(0x7f8b0c0b79b0 msgr2=0x7f8b0c131410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 shutdown_connections 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 -- 10.20.193.21:0/2613527953 wait complete. 2026-02-25T15:07:34.636 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.632+0000 7f8b10e30640 1 librados: shutdown 2026-02-25T15:07:34.642 INFO:tasks.ceph:Scrubbing osd.11 2026-02-25T15:07:34.642 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:34.711 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 10 monclient: get_monmap_and_config 2026-02-25T15:07:34.711 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 10 monclient: monmap: 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:34.710899+0000 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:34.710899+0000 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.712 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 1 Processor -- start 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 1 -- start start 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.710+0000 7efed493a640 10 monclient: init 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient(hunting): picked mon.noname-c con 0x7efecc15e2a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient(hunting): picked mon.noname-a con 0x7efecc059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient(hunting): picked mon.noname-b con 0x7efecc1a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc162df0 con 0x7efecc059e10 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc1630d0 con 0x7efecc1a5660 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc1633b0 con 0x7efecc15e2a0 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed493a640 10 monclient(hunting): authenticate will time out at 3398.303182s 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed1eae640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7efecc059e10 0x7efecc15ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43636/0 (socket says 10.20.193.21:43636) 2026-02-25T15:07:34.713 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.711+0000 7efed1eae640 1 -- 10.20.193.21:0/1992621669 learned_addr learned my addr 10.20.193.21:0/1992621669 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697763767 0 0) 0x7efecc162df0 con 0x7efecc059e10 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): my global_id is 28323 2026-02-25T15:07:34.714 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efebc003610 con 0x7efecc059e10 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 178336142 0 0) 0x7efecc1633b0 con 0x7efecc15e2a0 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): my global_id is 30959 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc162df0 con 0x7efecc15e2a0 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213193867 0 0) 0x7efecc1630d0 con 0x7efecc1a5660 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 10 monclient(hunting): my global_id is 29299 2026-02-25T15:07:34.715 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.713+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc1633b0 con 0x7efecc1a5660 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.714+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2859962638 0 0) 0x7efebc003610 con 0x7efecc059e10 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.714+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 >> v1:10.20.193.68:6789/0 conn(0x7efecc15e2a0 legacy=0x7efecc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.714+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 >> v1:10.20.193.31:6789/0 conn(0x7efecc1a5660 legacy=0x7efecc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 1 monclient: found mon.noname-a 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:34.716 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc163690 con 0x7efecc059e10 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efeb8002df0 con 0x7efecc059e10 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed16ad640 10 monclient: dump: 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed493a640 5 monclient: authenticate success, global_id 28323 2026-02-25T15:07:34.717 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.715+0000 7efed493a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efeb8002fc0 con 0x7efecc059e10 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 1 -- 10.20.193.21:0/1992621669 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efeb8003400 con 0x7efecc059e10 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed16ad640 10 monclient: dump: 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 4 set_mon_vals no callback set 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 10 monclient: shutdown 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 -- 10.20.193.21:0/1992621669 >> v1:10.20.193.21:6789/0 conn(0x7efecc059e10 legacy=0x7efecc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.718 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 -- 10.20.193.21:0/1992621669 shutdown_connections 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 -- 10.20.193.21:0/1992621669 >> 10.20.193.21:0/1992621669 conn(0x7efecc0b2f60 msgr2=0x7efecc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 -- 10.20.193.21:0/1992621669 shutdown_connections 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 -- 10.20.193.21:0/1992621669 wait complete. 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 10 monclient: monmap: 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.719 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 librados: starting msgr at 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 librados: starting objecter 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.716+0000 7efed493a640 1 Processor -- start 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 -- start start 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 librados: setting wanted keys 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 librados: calling monclient init 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient: init 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:34.720 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient(hunting): picked mon.noname-b con 0x7efecc059e10 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient(hunting): picked mon.noname-a con 0x7efecc15e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient(hunting): picked mon.noname-c con 0x7efecc1a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc0b0b80 con 0x7efecc15e2a0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc0b0e20 con 0x7efecc059e10 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efecc0b1100 con 0x7efecc1a5660 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed493a640 10 monclient(hunting): authenticate will time out at 3398.309446s 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed1eae640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7efecc15e2a0 0x7efecc12da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43642/0 (socket says 10.20.193.21:43642) 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efed1eae640 1 -- 10.20.193.21:0/3664335558 learned_addr learned my addr 10.20.193.21:0/3664335558 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efeb6ffd640 10 client.?.objecter ms_handle_connect 0x7efecc15e2a0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efeb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efeb6ffd640 10 client.?.objecter ms_handle_connect 0x7efecc1a5660 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.717+0000 7efeb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 client.?.objecter ms_handle_connect 0x7efecc059e10 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992699988 0 0) 0x7efecc0b0b80 con 0x7efecc15e2a0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): my global_id is 28326 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe9c003610 con 0x7efecc15e2a0 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272631229 0 0) 0x7efecc0b1100 con 0x7efecc1a5660 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): my global_id is 30962 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc0b0b80 con 0x7efecc1a5660 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937574353 0 0) 0x7efecc0b0e20 con 0x7efecc059e10 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.721 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.722 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.718+0000 7efeb6ffd640 10 monclient(hunting): my global_id is 29302 2026-02-25T15:07:34.722 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.719+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc0b1100 con 0x7efecc059e10 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 327569318 0 0) 0x7efe9c003610 con 0x7efecc15e2a0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efecc0b0e20 con 0x7efecc15e2a0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efeb8003310 con 0x7efecc15e2a0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4035757448 0 0) 0x7efecc0b0b80 con 0x7efecc1a5660 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe9c003610 con 0x7efecc1a5660 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efec0003410 con 0x7efecc1a5660 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.723 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1724494866 0 0) 0x7efecc0b1100 con 0x7efecc059e10 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efecc0b0b80 con 0x7efecc059e10 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efec4003070 con 0x7efecc059e10 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.721+0000 7efeb6ffd640 10 monclient(hunting): dump: 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.724 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 10031755 0 0) 0x7efe9c003610 con 0x7efecc1a5660 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 >> v1:10.20.193.31:6789/0 conn(0x7efecc059e10 legacy=0x7efecc192f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 >> v1:10.20.193.21:6789/0 conn(0x7efecc15e2a0 legacy=0x7efecc12da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 1 monclient: found mon.c 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc0b13e0 con 0x7efecc1a5660 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efeb6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 5 monclient: authenticate success, global_id 30962 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 monclient: _renew_subs 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efecc0b16c0 con 0x7efecc1a5660 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 client.30962.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 monclient: _renew_subs 2026-02-25T15:07:34.725 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efecc12e830 con 0x7efecc1a5660 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 1 librados: init done 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 client.30962.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 15 client.30962.objecter _session_command_op_assign -1 1 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 20 client.30962.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 client.30962.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.726 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.723+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7efecc05dcf0 con 0x7efecc1a5660 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efecc05dcf0 con 0x7efecc1a5660 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7efec0003c20 con 0x7efecc1a5660 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efeb6ffd640 10 monclient: dump: 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.733 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.731+0000 7efed0eac640 4 set_mon_vals no callback set 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.732+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7efec001d100 con 0x7efecc1a5660 2026-02-25T15:07:34.734 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efed26af640 10 monclient: get_auth_request con 0x7efe9c07a070 auth_method 0 2026-02-25T15:07:34.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 10 client.30962.objecter ms_handle_connect 0x7efe9c07a070 2026-02-25T15:07:34.735 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7efec0094940 con 0x7efecc1a5660 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 10 client.30962.objecter ms_dispatch2 0x7efecc000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 3 client.30962.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 3 client.30962.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 10 client.30962.objecter checking command 1 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter _get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 15 client.30962.objecter _session_command_op_remove -1 1 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter _get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 15 client.30962.objecter _session_command_op_assign 11 1 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 4 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 10 client.30962.objecter _send_command 1 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.72:6809/3875035713 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe9c0c6630 con 0x7efe9c0a49d0 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 20 client.30962.objecter dump_active .. 0 homeless 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7efec0059f10 con 0x7efecc1a5660 2026-02-25T15:07:34.736 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.733+0000 7efeb6ffd640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:34.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.734+0000 7efed1eae640 10 monclient: get_auth_request con 0x7efe9c0a49d0 auth_method 0 2026-02-25T15:07:34.737 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.735+0000 7efeb6ffd640 10 client.30962.objecter ms_handle_connect 0x7efe9c0a49d0 2026-02-25T15:07:34.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.744+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== osd.11 v1:10.20.193.72:6809/3875035713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7efe9c0c6630 con 0x7efe9c0a49d0 2026-02-25T15:07:34.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.744+0000 7efeb6ffd640 10 client.30962.objecter ms_dispatch2 0x7efecc000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:34.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.744+0000 7efeb6ffd640 10 client.30962.objecter _finish_command 1 = system:0 2026-02-25T15:07:34.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.744+0000 7efeb6ffd640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 4 2026-02-25T15:07:34.746 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.744+0000 7efeb6ffd640 15 client.30962.objecter _session_command_op_remove 11 1 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 10 client.30962.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 15 client.30962.objecter _session_command_op_assign -1 2 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 20 client.30962.objecter _get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 20 client.30962.objecter _get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 15 client.30962.objecter _session_command_op_remove -1 2 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 20 client.30962.objecter get_session s=0x7efe9c0a4320 osd=11 3 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 15 client.30962.objecter _session_command_op_assign 11 2 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 4 2026-02-25T15:07:34.753 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 10 client.30962.objecter _send_command 2 2026-02-25T15:07:34.754 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.751+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 --> v1:10.20.193.72:6809/3875035713 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efecc197d50 con 0x7efe9c0a49d0 2026-02-25T15:07:34.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.758+0000 7efeb6ffd640 1 -- 10.20.193.21:0/3664335558 <== osd.11 v1:10.20.193.72:6809/3875035713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7efecc197d50 con 0x7efe9c0a49d0 2026-02-25T15:07:34.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.758+0000 7efeb6ffd640 10 client.30962.objecter ms_dispatch2 0x7efecc000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.758+0000 7efeb6ffd640 10 client.30962.objecter _finish_command 2 = system:0 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.758+0000 7efeb6ffd640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 4 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.758+0000 7efeb6ffd640 15 client.30962.objecter _session_command_op_remove 11 2 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:34.761 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 10 librados: watch_flush enter 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 10 librados: watch_flush exit 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 10 client.30962.objecter close_session for osd.11 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 >> v1:10.20.193.72:6809/3875035713 conn(0x7efe9c0a49d0 legacy=0x7efe9c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 20 client.30962.objecter put_session s=0x7efe9c0a4320 osd=11 1 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 20 client.30962.objecter shutdown clearing up homeless session... 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 10 client.30962.objecter successfully canceled tick 2026-02-25T15:07:34.763 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 >> v1:10.20.193.72:6800/2463505645 conn(0x7efe9c07a070 legacy=0x7efe9c09a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 10 monclient: shutdown 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 >> v1:10.20.193.68:6789/0 conn(0x7efecc1a5660 legacy=0x7efecc12e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed2eb0640 1 -- 10.20.193.21:0/3664335558 reap_dead start 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 shutdown_connections 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 >> 10.20.193.21:0/3664335558 conn(0x7efecc0b2f60 msgr2=0x7efecc160560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 shutdown_connections 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 -- 10.20.193.21:0/3664335558 wait complete. 2026-02-25T15:07:34.764 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.759+0000 7efed493a640 1 librados: shutdown 2026-02-25T15:07:34.768 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 10 monclient: get_monmap_and_config 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 10 monclient: monmap: 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:34.834085+0000 2026-02-25T15:07:34.835 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:34.834085+0000 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.836 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 1 Processor -- start 2026-02-25T15:07:34.838 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 1 -- start start 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.833+0000 7fb526047640 10 monclient: init 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient(hunting): picked mon.noname-b con 0x7fb5201612c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient(hunting): picked mon.noname-a con 0x7fb5200b58e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient(hunting): picked mon.noname-c con 0x7fb5201620d0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52005b7d0 con 0x7fb5200b58e0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52005bab0 con 0x7fb5201612c0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52005bd90 con 0x7fb5201620d0 2026-02-25T15:07:34.839 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb526047640 10 monclient(hunting): authenticate will time out at 3398.426373s 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb525045640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fb5201612c0 0x7fb5200b51d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48850/0 (socket says 10.20.193.21:48850) 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.834+0000 7fb525045640 1 -- 10.20.193.21:0/1112360788 learned_addr learned my addr 10.20.193.21:0/1112360788 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194325849 0 0) 0x7fb52005b7d0 con 0x7fb5200b58e0 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): my global_id is 28329 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb508003610 con 0x7fb5200b58e0 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660076521 0 0) 0x7fb52005bd90 con 0x7fb5201620d0 2026-02-25T15:07:34.840 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): my global_id is 30965 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52005b7d0 con 0x7fb5201620d0 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038305554 0 0) 0x7fb52005bab0 con 0x7fb5201612c0 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 10 monclient(hunting): my global_id is 29305 2026-02-25T15:07:34.841 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.836+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52005bd90 con 0x7fb5201612c0 2026-02-25T15:07:34.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830166876 0 0) 0x7fb52005bd90 con 0x7fb5201612c0 2026-02-25T15:07:34.847 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 >> v1:10.20.193.68:6789/0 conn(0x7fb5201620d0 legacy=0x7fb520056090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 >> v1:10.20.193.21:6789/0 conn(0x7fb5200b58e0 legacy=0x7fb520055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 monclient: found mon.noname-b 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.31:6789/0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52005c070 con 0x7fb5201612c0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb510002dd0 con 0x7fb5201612c0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb50ffff640 10 monclient: dump: 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb526047640 5 monclient: authenticate success, global_id 29305 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.837+0000 7fb526047640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.1 v1:10.20.193.31:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb510002fe0 con 0x7fb5201612c0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 1 -- 10.20.193.21:0/1112360788 <== mon.1 v1:10.20.193.31:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb5100033e0 con 0x7fb5201612c0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 4 set_mon_vals no callback set 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb50ffff640 10 monclient: dump: 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.848 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 10 monclient: shutdown 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 1 -- 10.20.193.21:0/1112360788 >> v1:10.20.193.31:6789/0 conn(0x7fb5201612c0 legacy=0x7fb5200b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 1 -- 10.20.193.21:0/1112360788 shutdown_connections 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 1 -- 10.20.193.21:0/1112360788 >> 10.20.193.21:0/1112360788 conn(0x7fb5200b2d40 msgr2=0x7fb5200b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 1 -- 10.20.193.21:0/1112360788 shutdown_connections 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.838+0000 7fb526047640 1 -- 10.20.193.21:0/1112360788 wait complete. 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 10 monclient: build_initial_monmap 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 10 monclient: monmap: 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 librados: starting msgr at 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 librados: starting objecter 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 Processor -- start 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 -- start start 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 librados: setting wanted keys 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 1 librados: calling monclient init 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.839+0000 7fb526047640 10 monclient: init 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient(hunting): picked mon.noname-c con 0x7fb5200b58e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient(hunting): picked mon.noname-b con 0x7fb5201612c0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient(hunting): picked mon.noname-a con 0x7fb5201620d0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5200ae1e0 con 0x7fb5201620d0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5200ae4c0 con 0x7fb5201612c0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5200ae7a0 con 0x7fb5200b58e0 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb526047640 10 monclient(hunting): authenticate will time out at 3398.432210s 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb524844640 1 --1- >> v1:10.20.193.31:6789/0 conn(0x7fb5201612c0 0x7fb520057c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.31:6789/0 says I am v1:10.20.193.21:48864/0 (socket says 10.20.193.21:48864) 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb524844640 1 -- 10.20.193.21:0/697124294 learned_addr learned my addr 10.20.193.21:0/697124294 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:34.849 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb50dffb640 10 client.?.objecter ms_handle_connect 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.840+0000 7fb50dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 client.?.objecter ms_handle_connect 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 client.?.objecter ms_handle_connect 0x7fb5201620d0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889893028 0 0) 0x7fb5200ae4c0 con 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 10 monclient(hunting): my global_id is 29308 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.841+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4f0003610 con 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131207424 0 0) 0x7fb5200ae7a0 con 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): my global_id is 30968 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5200ae4c0 con 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784435254 0 0) 0x7fb5200ae1e0 con 0x7fb5201620d0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 10 monclient(hunting): my global_id is 28332 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.842+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5200ae7a0 con 0x7fb5201620d0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4135507478 0 0) 0x7fb5200ae4c0 con 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5200ae1e0 con 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb510002ce0 con 0x7fb5200b58e0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3562887452 0 0) 0x7fb4f0003610 con 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5200ae4c0 con 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb514003040 con 0x7fb5201612c0 2026-02-25T15:07:34.850 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 148494343 0 0) 0x7fb5200ae7a0 con 0x7fb5201620d0 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4f0003610 con 0x7fb5201620d0 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb51c003430 con 0x7fb5201620d0 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.844+0000 7fb50dffb640 10 monclient(hunting): dump: 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.851 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2013856606 0 0) 0x7fb5200ae1e0 con 0x7fb5200b58e0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 >> v1:10.20.193.31:6789/0 conn(0x7fb5201612c0 legacy=0x7fb520057c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 >> v1:10.20.193.21:6789/0 conn(0x7fb5201620d0 legacy=0x7fb52025f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 1 monclient: found mon.c 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5200aea80 con 0x7fb5200b58e0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb50dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 5 monclient: authenticate success, global_id 30968 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _renew_subs 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5200aed60 con 0x7fb5200b58e0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 client.30968.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _renew_subs 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb520058350 con 0x7fb5200b58e0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 1 librados: init done 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:34.852 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.846+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5200585e0 con 0x7fb5200b58e0 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb510002f70 con 0x7fb5200b58e0 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7fb510004d20 con 0x7fb5200b58e0 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 10 monclient: dump: 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:34.855 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50f7fe640 4 set_mon_vals no callback set 2026-02-25T15:07:34.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.854+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7fb51001e200 con 0x7fb5200b58e0 2026-02-25T15:07:34.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.855+0000 7fb524844640 10 monclient: get_auth_request con 0x7fb4f007a090 auth_method 0 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.855+0000 7fb50dffb640 10 client.30968.objecter ms_handle_connect 0x7fb4f007a090 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.856+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7fb5100959a0 con 0x7fb5200b58e0 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.856+0000 7fb50dffb640 10 client.30968.objecter ms_dispatch2 0x7fb520000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.856+0000 7fb50dffb640 3 client.30968.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.856+0000 7fb50dffb640 3 client.30968.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:34.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.856+0000 7fb50dffb640 20 client.30968.objecter dump_active .. 0 homeless 2026-02-25T15:07:34.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.939+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7fb51005f300 con 0x7fb5200b58e0 2026-02-25T15:07:34.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.939+0000 7fb50dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:34.941 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:34.939+0000 7fb50dffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:35.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.046+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7fb5200adf90 con 0x7fb4f007a090 2026-02-25T15:07:35.049 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb50dffb640 1 -- 10.20.193.21:0/697124294 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7fb5200adf90 con 0x7fb4f007a090 2026-02-25T15:07:35.049 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 11 to deep-scrub 2026-02-25T15:07:35.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 10 librados: watch_flush enter 2026-02-25T15:07:35.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 10 librados: watch_flush exit 2026-02-25T15:07:35.050 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 20 client.30968.objecter shutdown clearing up homeless session... 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 10 client.30968.objecter successfully canceled tick 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 >> v1:10.20.193.72:6800/2463505645 conn(0x7fb4f007a090 legacy=0x7fb4f009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 10 monclient: shutdown 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 >> v1:10.20.193.68:6789/0 conn(0x7fb5200b58e0 legacy=0x7fb520135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.047+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 shutdown_connections 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.048+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 >> 10.20.193.21:0/697124294 conn(0x7fb5200b2d40 msgr2=0x7fb520164160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.048+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 shutdown_connections 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.048+0000 7fb526047640 1 -- 10.20.193.21:0/697124294 wait complete. 2026-02-25T15:07:35.051 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.048+0000 7fb526047640 1 librados: shutdown 2026-02-25T15:07:35.058 INFO:tasks.ceph:Scrubbing osd.15 2026-02-25T15:07:35.058 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: get_monmap_and_config 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: monmap: 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.128 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:35.126778+0000 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:35.126778+0000 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 1 Processor -- start 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 1 -- start start 2026-02-25T15:07:35.129 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: init 2026-02-25T15:07:35.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.132 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.126+0000 7ff5360c6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-b con 0x7ff53015e2a0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-a con 0x7ff530059e10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-c con 0x7ff5301a5660 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530162df0 con 0x7ff530059e10 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5301630d0 con 0x7ff53015e2a0 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5301633b0 con 0x7ff5301a5660 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff5360c6640 10 monclient(hunting): authenticate will time out at 3398.719062s 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff52effd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff530059e10 0x7ff53015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43662/0 (socket says 10.20.193.21:43662) 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.127+0000 7ff52effd640 1 -- 10.20.193.21:0/3726348860 learned_addr learned my addr 10.20.193.21:0/3726348860 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.133 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621828490 0 0) 0x7ff530162df0 con 0x7ff530059e10 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): my global_id is 28335 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff514003610 con 0x7ff530059e10 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057018956 0 0) 0x7ff5301633b0 con 0x7ff5301a5660 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 10 monclient(hunting): my global_id is 30971 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.128+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff530162df0 con 0x7ff5301a5660 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270421325 0 0) 0x7ff5301630d0 con 0x7ff53015e2a0 2026-02-25T15:07:35.134 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 10 monclient(hunting): my global_id is 29311 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.129+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5301633b0 con 0x7ff53015e2a0 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629625955 0 0) 0x7ff530162df0 con 0x7ff5301a5660 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 >> v1:10.20.193.31:6789/0 conn(0x7ff53015e2a0 legacy=0x7ff53005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 >> v1:10.20.193.21:6789/0 conn(0x7ff530059e10 legacy=0x7ff53015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 monclient: found mon.noname-c 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.135 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff530163690 con 0x7ff5301a5660 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff524003170 con 0x7ff5301a5660 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff5360c6640 5 monclient: authenticate success, global_id 30971 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff5360c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff52e7fc640 10 monclient: dump: 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.136 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.137 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.130+0000 7ff5360c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:35.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff524003340 con 0x7ff5301a5660 2026-02-25T15:07:35.143 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 1 -- 10.20.193.21:0/3726348860 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff524003780 con 0x7ff5301a5660 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 4 set_mon_vals no callback set 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff52e7fc640 10 monclient: dump: 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.144 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 10 monclient: shutdown 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 1 -- 10.20.193.21:0/3726348860 >> v1:10.20.193.68:6789/0 conn(0x7ff5301a5660 legacy=0x7ff5301c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 1 -- 10.20.193.21:0/3726348860 shutdown_connections 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 1 -- 10.20.193.21:0/3726348860 >> 10.20.193.21:0/3726348860 conn(0x7ff5300b2f60 msgr2=0x7ff5300b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 1 -- 10.20.193.21:0/3726348860 shutdown_connections 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.131+0000 7ff5360c6640 1 -- 10.20.193.21:0/3726348860 wait complete. 2026-02-25T15:07:35.145 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 10 monclient: monmap: 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.146 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 librados: starting msgr at 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 librados: starting objecter 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 Processor -- start 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 -- start start 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 librados: setting wanted keys 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 1 librados: calling monclient init 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.132+0000 7ff5360c6640 10 monclient: init 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-c con 0x7ff530059e10 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-a con 0x7ff53015e2a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient(hunting): picked mon.noname-b con 0x7ff5301a5660 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.147 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530055a20 con 0x7ff53015e2a0 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530055d00 con 0x7ff5301a5660 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530055fe0 con 0x7ff530059e10 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff5360c6640 10 monclient(hunting): authenticate will time out at 3398.725174s 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff52effd640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff53015e2a0 0x7ff530056da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43664/0 (socket says 10.20.193.21:43664) 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff52effd640 1 -- 10.20.193.21:0/1989755670 learned_addr learned my addr 10.20.193.21:0/1989755670 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff50bfff640 10 client.?.objecter ms_handle_connect 0x7ff53015e2a0 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff50bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff50bfff640 10 client.?.objecter ms_handle_connect 0x7ff530059e10 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.133+0000 7ff50bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841691804 0 0) 0x7ff530055fe0 con 0x7ff530059e10 2026-02-25T15:07:35.148 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): my global_id is 30974 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff500003610 con 0x7ff530059e10 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563538503 0 0) 0x7ff530055a20 con 0x7ff53015e2a0 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 monclient(hunting): my global_id is 28338 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff530055fe0 con 0x7ff53015e2a0 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 client.?.objecter ms_handle_connect 0x7ff5301a5660 2026-02-25T15:07:35.149 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.134+0000 7ff50bfff640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158150969 0 0) 0x7ff530055d00 con 0x7ff5301a5660 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 10 monclient(hunting): my global_id is 29314 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.135+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff530055a20 con 0x7ff5301a5660 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1433966988 0 0) 0x7ff500003610 con 0x7ff530059e10 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff530055d00 con 0x7ff530059e10 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff51c003060 con 0x7ff530059e10 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:35.150 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 10 monclient(hunting): dump: 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.136+0000 7ff50bfff640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2758957849 0 0) 0x7ff530055fe0 con 0x7ff53015e2a0 2026-02-25T15:07:35.151 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff500003610 con 0x7ff53015e2a0 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff520002f90 con 0x7ff53015e2a0 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): dump: 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.152 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 312111048 0 0) 0x7ff530055a20 con 0x7ff5301a5660 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff530055fe0 con 0x7ff5301a5660 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff524003690 con 0x7ff5301a5660 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.137+0000 7ff50bfff640 10 monclient(hunting): dump: 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.153 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2386783954 0 0) 0x7ff530055d00 con 0x7ff530059e10 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 >> v1:10.20.193.31:6789/0 conn(0x7ff5301a5660 legacy=0x7ff5300b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 >> v1:10.20.193.21:6789/0 conn(0x7ff53015e2a0 legacy=0x7ff530056da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 1 monclient: found mon.c 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.154 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300562c0 con 0x7ff530059e10 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff50bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 5 monclient: authenticate success, global_id 30974 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 10 monclient: _renew_subs 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5300565a0 con 0x7ff530059e10 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 10 client.30974.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 10 monclient: _renew_subs 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5301943a0 con 0x7ff530059e10 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.138+0000 7ff5360c6640 1 librados: init done 2026-02-25T15:07:35.155 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 10 client.30974.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 15 client.30974.objecter _session_command_op_assign -1 1 2026-02-25T15:07:35.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 20 client.30974.objecter _get_session osd=-1 returning homeless 2026-02-25T15:07:35.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 10 client.30974.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:35.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.156 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.139+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.68:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff530162df0 con 0x7ff530059e10 2026-02-25T15:07:35.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff530162df0 con 0x7ff530059e10 2026-02-25T15:07:35.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff51c0038a0 con 0x7ff530059e10 2026-02-25T15:07:35.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.158 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff50bfff640 10 monclient: dump: 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.146+0000 7ff52dffb640 4 set_mon_vals no callback set 2026-02-25T15:07:35.159 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.147+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff51c01cd80 con 0x7ff530059e10 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff52effd640 10 monclient: get_auth_request con 0x7ff50007a000 auth_method 0 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7ff51c094650 con 0x7ff530059e10 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 10 client.30974.objecter ms_dispatch2 0x7ff530000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 3 client.30974.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 3 client.30974.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 10 client.30974.objecter checking command 1 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter _get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 15 client.30974.objecter _session_command_op_remove -1 1 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter _get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 15 client.30974.objecter _session_command_op_assign 15 1 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 4 2026-02-25T15:07:35.160 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 10 client.30974.objecter _send_command 1 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.72:6801/4086098431 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5000c65c0 con 0x7ff5000a4960 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 20 client.30974.objecter dump_active .. 0 homeless 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.148+0000 7ff50bfff640 10 client.30974.objecter ms_handle_connect 0x7ff50007a000 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.149+0000 7ff52ffff640 10 monclient: get_auth_request con 0x7ff5000a4960 auth_method 0 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.149+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_get_version_reply(handle=1 version=342) ==== 24+0+0 (unknown 4256368909 0 0) 0x7ff51c059c20 con 0x7ff530059e10 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.149+0000 7ff50bfff640 10 monclient: handle_get_version_reply finishing 1 version 342 2026-02-25T15:07:35.161 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.150+0000 7ff50bfff640 10 client.30974.objecter ms_handle_connect 0x7ff5000a4960 2026-02-25T15:07:35.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.160+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== osd.15 v1:10.20.193.72:6801/4086098431 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff5000c65c0 con 0x7ff5000a4960 2026-02-25T15:07:35.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.160+0000 7ff50bfff640 10 client.30974.objecter ms_dispatch2 0x7ff530000b90 command_reply(tid 1: 0 ) 2026-02-25T15:07:35.162 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.160+0000 7ff50bfff640 10 client.30974.objecter _finish_command 1 = system:0 2026-02-25T15:07:35.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.160+0000 7ff50bfff640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 4 2026-02-25T15:07:35.163 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.160+0000 7ff50bfff640 15 client.30974.objecter _session_command_op_remove 15 1 2026-02-25T15:07:35.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 10 client.30974.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-25T15:07:35.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 15 client.30974.objecter _session_command_op_assign -1 2 2026-02-25T15:07:35.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 20 client.30974.objecter _get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 20 client.30974.objecter _get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 15 client.30974.objecter _session_command_op_remove -1 2 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 20 client.30974.objecter get_session s=0x7ff5000a42b0 osd=15 3 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 15 client.30974.objecter _session_command_op_assign 15 2 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 4 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 10 client.30974.objecter _send_command 2 2026-02-25T15:07:35.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.167+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 --> v1:10.20.193.72:6801/4086098431 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff53015fbb0 con 0x7ff5000a4960 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff50bfff640 1 -- 10.20.193.21:0/1989755670 <== osd.15 v1:10.20.193.72:6801/4086098431 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff53015fbb0 con 0x7ff5000a4960 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff50bfff640 10 client.30974.objecter ms_dispatch2 0x7ff530000b90 command_reply(tid 2: 0 ) 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff50bfff640 10 client.30974.objecter _finish_command 2 = system:0 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff50bfff640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 4 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff50bfff640 15 client.30974.objecter _session_command_op_remove 15 2 2026-02-25T15:07:35.177 INFO:teuthology.orchestra.run.trial021.stdout:{ 2026-02-25T15:07:35.178 INFO:teuthology.orchestra.run.trial021.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-25T15:07:35.178 INFO:teuthology.orchestra.run.trial021.stdout:} 2026-02-25T15:07:35.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 10 librados: watch_flush enter 2026-02-25T15:07:35.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 10 librados: watch_flush exit 2026-02-25T15:07:35.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 10 client.30974.objecter close_session for osd.15 2026-02-25T15:07:35.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 >> v1:10.20.193.72:6801/4086098431 conn(0x7ff5000a4960 legacy=0x7ff5000c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 20 client.30974.objecter put_session s=0x7ff5000a42b0 osd=15 1 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 20 client.30974.objecter shutdown clearing up homeless session... 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 10 client.30974.objecter successfully canceled tick 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff50007a000 legacy=0x7ff50009a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 10 monclient: shutdown 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 >> v1:10.20.193.68:6789/0 conn(0x7ff530059e10 legacy=0x7ff53011e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff52ffff640 1 -- 10.20.193.21:0/1989755670 reap_dead start 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 shutdown_connections 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 >> 10.20.193.21:0/1989755670 conn(0x7ff5300b2f60 msgr2=0x7ff53015ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 shutdown_connections 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 -- 10.20.193.21:0/1989755670 wait complete. 2026-02-25T15:07:35.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.175+0000 7ff5360c6640 1 librados: shutdown 2026-02-25T15:07:35.184 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-25T15:07:35.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.250+0000 7f467a69f640 10 monclient: get_monmap_and_config 2026-02-25T15:07:35.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.250+0000 7f467a69f640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.252 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.250+0000 7f467a69f640 10 monclient: monmap: 2026-02-25T15:07:35.252 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.252 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:35.251305+0000 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:35.251305+0000 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.253 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 1 Processor -- start 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 1 -- start start 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 10 monclient: init 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.251+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-c con 0x7f46740b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-a con 0x7f46740ba350 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.256 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-b con 0x7f46740585e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4674163930 con 0x7f46740ba350 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4674163bb0 con 0x7f46740585e0 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4674163e90 con 0x7f46740b9f80 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f467a69f640 10 monclient(hunting): authenticate will time out at 3398.844045s 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f46737fe640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f46740ba350 0x7f4674057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43672/0 (socket says 10.20.193.21:43672) 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.252+0000 7f46737fe640 1 -- 10.20.193.21:0/1361441975 learned_addr learned my addr 10.20.193.21:0/1361441975 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035565151 0 0) 0x7f4664002910 con 0x7f46740ba350 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.257 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): my global_id is 28341 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4658003610 con 0x7f46740ba350 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212913897 0 0) 0x7f4674163e90 con 0x7f46740b9f80 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): my global_id is 30977 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4664002910 con 0x7f46740b9f80 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 210639847 0 0) 0x7f4674163bb0 con 0x7f46740585e0 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.258 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 10 monclient(hunting): my global_id is 29317 2026-02-25T15:07:35.259 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.253+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4674163e90 con 0x7f46740585e0 2026-02-25T15:07:35.265 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 489034058 0 0) 0x7f4658003610 con 0x7f46740ba350 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 >> v1:10.20.193.68:6789/0 conn(0x7f46740b9f80 legacy=0x7f4674163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 >> v1:10.20.193.31:6789/0 conn(0x7f46740585e0 legacy=0x7f4674166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 monclient: found mon.noname-a 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.21:6789/0 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 --> v1:10.20.193.21:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46740573f0 con 0x7f46740ba350 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f467a69f640 5 monclient: authenticate success, global_id 28341 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f467a69f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4664002fc0 con 0x7f46740ba350 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f4672ffd640 10 monclient: dump: 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.267 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.255+0000 7f467a69f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.0 v1:10.20.193.21:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4664003210 con 0x7f46740ba350 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 4 set_mon_vals no callback set 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 1 -- 10.20.193.21:0/1361441975 <== mon.0 v1:10.20.193.21:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4664004990 con 0x7f46740ba350 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:35.268 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f4672ffd640 10 monclient: dump: 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 10 monclient: shutdown 2026-02-25T15:07:35.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 1 -- 10.20.193.21:0/1361441975 >> v1:10.20.193.21:6789/0 conn(0x7f46740ba350 legacy=0x7f4674057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 1 -- 10.20.193.21:0/1361441975 shutdown_connections 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 1 -- 10.20.193.21:0/1361441975 >> 10.20.193.21:0/1361441975 conn(0x7f46740b7990 msgr2=0x7f46740b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 1 -- 10.20.193.21:0/1361441975 shutdown_connections 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.256+0000 7f467a69f640 1 -- 10.20.193.21:0/1361441975 wait complete. 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient: monmap: 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:35.270 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 librados: starting msgr at 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 librados: starting objecter 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 Processor -- start 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 -- start start 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 librados: setting wanted keys 2026-02-25T15:07:35.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 librados: calling monclient init 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient: init 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-a con 0x7f46740585e0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-c con 0x7f46740b9f80 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient(hunting): picked mon.noname-b con 0x7f46740ba350 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46741ff0c0 con 0x7f46740585e0 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46741fcb00 con 0x7f46740ba350 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46741fcde0 con 0x7f46740b9f80 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.257+0000 7f467a69f640 10 monclient(hunting): authenticate will time out at 3398.849809s 2026-02-25T15:07:35.272 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4673fff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f46740585e0 0x7f46741fde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:43686/0 (socket says 10.20.193.21:43686) 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4673fff640 1 -- 10.20.193.21:0/744850804 learned_addr learned my addr 10.20.193.21:0/744850804 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter ms_handle_connect 0x7f46740585e0 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter ms_handle_connect 0x7f46740ba350 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter ms_handle_connect 0x7f46740b9f80 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.258+0000 7f4670ff9640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960947594 0 0) 0x7f46741fcb00 con 0x7f46740ba350 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.273 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): my global_id is 29320 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4644003610 con 0x7f46740ba350 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939131548 0 0) 0x7f46741ff0c0 con 0x7f46740585e0 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): my global_id is 28344 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46741fcb00 con 0x7f46740585e0 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427463942 0 0) 0x7f46741fcde0 con 0x7f46740b9f80 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.274 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 10 monclient(hunting): my global_id is 30980 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.259+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46741ff0c0 con 0x7f46740b9f80 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3393163948 0 0) 0x7f4644003610 con 0x7f46740ba350 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46741fcde0 con 0x7f46740ba350 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4668003410 con 0x7f46740ba350 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.275 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 321776576 0 0) 0x7f46741ff0c0 con 0x7f46740b9f80 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4644003610 con 0x7f46740b9f80 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4664003560 con 0x7f46740b9f80 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:35.276 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.261+0000 7f4670ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2532015355 0 0) 0x7f46741fcb00 con 0x7f46740585e0 2026-02-25T15:07:35.277 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46741ff0c0 con 0x7f46740585e0 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f46600030c0 con 0x7f46740585e0 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.262+0000 7f4670ff9640 10 monclient(hunting): dump: 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.278 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4268202682 0 0) 0x7f46741fcde0 con 0x7f46740ba350 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 >> v1:10.20.193.68:6789/0 conn(0x7f46740b9f80 legacy=0x7f46741fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 >> v1:10.20.193.21:6789/0 conn(0x7f46740585e0 legacy=0x7f46741fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 1 monclient: found mon.b 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46741fd0c0 con 0x7f46740ba350 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.279 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f4670ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 5 monclient: authenticate success, global_id 29320 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _renew_subs 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46741fd3a0 con 0x7f46740ba350 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 client.29320.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _renew_subs 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f46741fd960 con 0x7f46740ba350 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 1 librados: init done 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.280 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.281 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.263+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46741678f0 con 0x7f46740ba350 2026-02-25T15:07:35.359 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4668003a80 con 0x7f46740ba350 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f4668003dd0 con 0x7f46740ba350 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f4670ff9640 10 monclient: dump: 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.360 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.361 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.358+0000 7f46727fc640 4 set_mon_vals no callback set 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.359+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f466801d2b0 con 0x7f46740ba350 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.359+0000 7f4673fff640 10 monclient: get_auth_request con 0x7f4644079ff0 auth_method 0 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f4668094b90 con 0x7f46740ba350 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 10 client.29320.objecter ms_dispatch2 0x7f4674000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 3 client.29320.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:35.362 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 3 client.29320.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:35.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 20 client.29320.objecter dump_active .. 0 homeless 2026-02-25T15:07:35.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.360+0000 7f4670ff9640 10 client.29320.objecter ms_handle_connect 0x7f4644079ff0 2026-02-25T15:07:35.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.361+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f4668094e20 con 0x7f46740ba350 2026-02-25T15:07:35.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.361+0000 7f4670ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.363 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.361+0000 7f4670ff9640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:35.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.467+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f46740b64c0 con 0x7f4644079ff0 2026-02-25T15:07:35.469 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.467+0000 7f4670ff9640 1 -- 10.20.193.21:0/744850804 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7f46740b64c0 con 0x7f4644079ff0 2026-02-25T15:07:35.469 INFO:teuthology.orchestra.run.trial021.stderr:instructed osd(s) 15 to deep-scrub 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 10 librados: watch_flush enter 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 10 librados: watch_flush exit 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 20 client.29320.objecter shutdown clearing up homeless session... 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 10 client.29320.objecter successfully canceled tick 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 >> v1:10.20.193.72:6800/2463505645 conn(0x7f4644079ff0 legacy=0x7f464409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 10 monclient: shutdown 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 >> v1:10.20.193.31:6789/0 conn(0x7f46740ba350 legacy=0x7f4674155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 shutdown_connections 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 >> 10.20.193.21:0/744850804 conn(0x7f46740b7990 msgr2=0x7f46740b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 shutdown_connections 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 -- 10.20.193.21:0/744850804 wait complete. 2026-02-25T15:07:35.470 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.468+0000 7f467a69f640 1 librados: shutdown 2026-02-25T15:07:35.479 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 10 monclient: get_monmap_and_config 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 10 monclient: monmap: 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:35.545944+0000 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:35.545944+0000 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.547 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.548 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.548 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.548 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.548 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 1 Processor -- start 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 1 -- start start 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.545+0000 7ff50b926640 10 monclient: init 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:35.550 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-b con 0x7ff504058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-c con 0x7ff5040b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-a con 0x7ff5041626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5041655c0 con 0x7ff5041626a0 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5040b12b0 con 0x7ff504058da0 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5040b1590 con 0x7ff5040b0410 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff50b926640 10 monclient(hunting): authenticate will time out at 3399.138341s 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff508e9a640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff5040b0410 0x7ff504164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48356/0 (socket says 10.20.193.21:48356) 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.546+0000 7ff508e9a640 1 -- 10.20.193.21:0/3920603291 learned_addr learned my addr 10.20.193.21:0/3920603291 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960282785 0 0) 0x7ff5040b1590 con 0x7ff5040b0410 2026-02-25T15:07:35.551 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): my global_id is 30983 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ec003610 con 0x7ff5040b0410 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195309082 0 0) 0x7ff5041655c0 con 0x7ff5041626a0 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): my global_id is 28347 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5040b1590 con 0x7ff5041626a0 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 929737080 0 0) 0x7ff5040b12b0 con 0x7ff504058da0 2026-02-25T15:07:35.552 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 10 monclient(hunting): my global_id is 29323 2026-02-25T15:07:35.553 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.548+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5041655c0 con 0x7ff504058da0 2026-02-25T15:07:35.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3888851999 0 0) 0x7ff4ec003610 con 0x7ff5040b0410 2026-02-25T15:07:35.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 >> v1:10.20.193.31:6789/0 conn(0x7ff504058da0 legacy=0x7ff5041647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.558 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 >> v1:10.20.193.21:6789/0 conn(0x7ff5041626a0 legacy=0x7ff5041c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 monclient: found mon.noname-c 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5040b1870 con 0x7ff5040b0410 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff4f8002df0 con 0x7ff5040b0410 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.559 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff4f3fff640 10 monclient: dump: 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.560 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff50b926640 5 monclient: authenticate success, global_id 30983 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.549+0000 7ff50b926640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4f8003040 con 0x7ff5040b0410 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 1 -- 10.20.193.21:0/3920603291 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff4f8003480 con 0x7ff5040b0410 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff4f3fff640 10 monclient: dump: 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.561 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff50b926640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.550+0000 7ff50b926640 4 set_mon_vals no callback set 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 10 monclient: shutdown 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- 10.20.193.21:0/3920603291 >> v1:10.20.193.68:6789/0 conn(0x7ff5040b0410 legacy=0x7ff504164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- 10.20.193.21:0/3920603291 shutdown_connections 2026-02-25T15:07:35.562 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- 10.20.193.21:0/3920603291 >> 10.20.193.21:0/3920603291 conn(0x7ff5040b65f0 msgr2=0x7ff5040b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- 10.20.193.21:0/3920603291 shutdown_connections 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- 10.20.193.21:0/3920603291 wait complete. 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 10 monclient: build_initial_monmap 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 10 monclient: monmap: 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:35.563 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 librados: starting msgr at 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 librados: starting objecter 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 Processor -- start 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 -- start start 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 librados: setting wanted keys 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 1 librados: calling monclient init 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.551+0000 7ff50b926640 10 monclient: init 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:35.564 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-c con 0x7ff504058da0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-b con 0x7ff5040b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient(hunting): picked mon.noname-a con 0x7ff5041626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff504136a50 con 0x7ff5041626a0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff504136d30 con 0x7ff5040b0410 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff504137010 con 0x7ff504058da0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50b926640 10 monclient(hunting): authenticate will time out at 3399.144309s 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50969b640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff504058da0 0x7ff5041fa050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.21:48358/0 (socket says 10.20.193.21:48358) 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff50969b640 1 -- 10.20.193.21:0/1729320181 learned_addr learned my addr 10.20.193.21:0/1729320181 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter ms_handle_connect 0x7ff504058da0 2026-02-25T15:07:35.565 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter ms_handle_connect 0x7ff5040b0410 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter ms_handle_connect 0x7ff5041626a0 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.552+0000 7ff4f1ffb640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179357001 0 0) 0x7ff504137010 con 0x7ff504058da0 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): my global_id is 30986 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4d4003610 con 0x7ff504058da0 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571485911 0 0) 0x7ff504136d30 con 0x7ff5040b0410 2026-02-25T15:07:35.566 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 10 monclient(hunting): my global_id is 29326 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.553+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff504137010 con 0x7ff5040b0410 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145684713 0 0) 0x7ff504136a50 con 0x7ff5041626a0 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 10 monclient(hunting): _negotiate 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 10 monclient(hunting): my global_id is 28350 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.554+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff504136d30 con 0x7ff5041626a0 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3314987384 0 0) 0x7ff504137010 con 0x7ff5040b0410 2026-02-25T15:07:35.567 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff504136a50 con 0x7ff5040b0410 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff4f80031f0 con 0x7ff5040b0410 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.568 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 840292651 0 0) 0x7ff504136d30 con 0x7ff5041626a0 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff504137010 con 0x7ff5041626a0 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff500003290 con 0x7ff5041626a0 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.569 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3456621670 0 0) 0x7ff4d4003610 con 0x7ff504058da0 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff504136d30 con 0x7ff504058da0 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff4f4003170 con 0x7ff504058da0 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:35.570 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.556+0000 7ff4f1ffb640 10 monclient(hunting): dump: 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.571 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1132914711 0 0) 0x7ff504136a50 con 0x7ff5040b0410 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 >> v1:10.20.193.68:6789/0 conn(0x7ff504058da0 legacy=0x7ff5041fa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 >> v1:10.20.193.21:6789/0 conn(0x7ff5041626a0 legacy=0x7ff50413c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 10 monclient: _finish_hunting 0 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 1 monclient: found mon.b 2026-02-25T15:07:35.573 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5041372f0 con 0x7ff5040b0410 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 10 monclient: _finish_auth 0 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 10 monclient: _check_auth_tickets 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff4f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 5 monclient: authenticate success, global_id 29326 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 10 monclient: _renew_subs 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5041375d0 con 0x7ff5040b0410 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 10 client.29326.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 10 monclient: _renew_subs 2026-02-25T15:07:35.574 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5041f9a30 con 0x7ff5040b0410 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.557+0000 7ff50b926640 1 librados: init done 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.558+0000 7ff50b926640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.558+0000 7ff50b926640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.558+0000 7ff50b926640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:35.575 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.558+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50405de60 con 0x7ff5040b0410 2026-02-25T15:07:35.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4f8003390 con 0x7ff5040b0410 2026-02-25T15:07:35.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:35.652 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff4f8004ce0 con 0x7ff5040b0410 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 10 monclient: dump: 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:35.653 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:35.654 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:35.654 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f37fe640 4 set_mon_vals no callback set 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.651+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff4f801e1c0 con 0x7ff5040b0410 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff50969b640 10 monclient: get_auth_request con 0x7ff4d407a0e0 auth_method 0 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7ff4f80959f0 con 0x7ff5040b0410 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 10 client.29326.objecter ms_dispatch2 0x7ff504000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 3 client.29326.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 3 client.29326.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 20 client.29326.objecter dump_active .. 0 homeless 2026-02-25T15:07:35.655 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.652+0000 7ff4f1ffb640 10 client.29326.objecter ms_handle_connect 0x7ff4d407a0e0 2026-02-25T15:07:35.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.653+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7ff4f805f350 con 0x7ff5040b0410 2026-02-25T15:07:35.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.653+0000 7ff4f1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:35.656 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.653+0000 7ff4f1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:35.760 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.758+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff504059f70 con 0x7ff4d407a0e0 2026-02-25T15:07:35.761 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.760+0000 7ff4f1ffb640 1 -- 10.20.193.21:0/1729320181 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125325 (unknown 2965378022 0 799122802) 0x7ff504059f70 con 0x7ff4d407a0e0 2026-02-25T15:07:35.763 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:35.763 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 10 librados: watch_flush enter 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 10 librados: watch_flush exit 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 20 client.29326.objecter shutdown clearing up homeless session... 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 10 client.29326.objecter successfully canceled tick 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff4d407a0e0 legacy=0x7ff4d409a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 10 monclient: shutdown 2026-02-25T15:07:35.765 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 >> v1:10.20.193.31:6789/0 conn(0x7ff5040b0410 legacy=0x7ff50413e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 shutdown_connections 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 >> 10.20.193.21:0/1729320181 conn(0x7ff5040b65f0 msgr2=0x7ff504056500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 shutdown_connections 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 -- 10.20.193.21:0/1729320181 wait complete. 2026-02-25T15:07:35.766 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:35.761+0000 7ff50b926640 1 librados: shutdown 2026-02-25T15:07:35.772 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2026-02-25T15:07:33.799165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":559960,"kb_used_data":110552,"kb_used_omap":23223,"kb_used_meta":425928,"kb_avail":1509389480,"statfs":{"total":1546188226560,"available":1545614827520,"internally_reserved":0,"allocated":113205248,"data_stored":69748176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23781236,"internal_metadata":436150412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.973112"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.985293+0000","last_change":"2026-02-25T15:01:50.952960+0000","last_active":"2026-02-25T15:07:25.985293+0000","last_peered":"2026-02-25T15:07:25.985293+0000","last_clean":"2026-02-25T15:07:25.985293+0000","last_became_active":"2026-02-25T15:01:50.928434+0000","last_became_peered":"2026-02-25T15:01:50.928434+0000","last_unstale":"2026-02-25T15:07:25.985293+0000","last_undegraded":"2026-02-25T15:07:25.985293+0000","last_fullsized":"2026-02-25T15:07:25.985293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:04:36.449802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.973361+0000","last_change":"2026-02-25T15:01:51.873447+0000","last_active":"2026-02-25T15:07:25.973361+0000","last_peered":"2026-02-25T15:07:25.973361+0000","last_clean":"2026-02-25T15:07:25.973361+0000","last_became_active":"2026-02-25T15:01:51.860656+0000","last_became_peered":"2026-02-25T15:01:51.860656+0000","last_unstale":"2026-02-25T15:07:25.973361+0000","last_undegraded":"2026-02-25T15:07:25.973361+0000","last_fullsized":"2026-02-25T15:07:25.973361+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.276300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.980623+0000","last_change":"2026-02-25T15:01:50.973519+0000","last_active":"2026-02-25T15:07:25.980623+0000","last_peered":"2026-02-25T15:07:25.980623+0000","last_clean":"2026-02-25T15:07:25.980623+0000","last_became_active":"2026-02-25T15:01:50.970996+0000","last_became_peered":"2026-02-25T15:01:50.970996+0000","last_unstale":"2026-02-25T15:07:25.980623+0000","last_undegraded":"2026-02-25T15:07:25.980623+0000","last_fullsized":"2026-02-25T15:07:25.980623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:26:45.944493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.977354+0000","last_change":"2026-02-25T15:01:51.088801+0000","last_active":"2026-02-25T15:07:25.977354+0000","last_peered":"2026-02-25T15:07:25.977354+0000","last_clean":"2026-02-25T15:07:25.977354+0000","last_became_active":"2026-02-25T15:01:50.996313+0000","last_became_peered":"2026-02-25T15:01:50.996313+0000","last_unstale":"2026-02-25T15:07:25.977354+0000","last_undegraded":"2026-02-25T15:07:25.977354+0000","last_fullsized":"2026-02-25T15:07:25.977354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:06:48.841244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,14],"acting":[3,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":629,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.024758+0000","last_change":"2026-02-25T15:01:50.401182+0000","last_active":"2026-02-25T15:07:26.024758+0000","last_peered":"2026-02-25T15:07:26.024758+0000","last_clean":"2026-02-25T15:07:26.024758+0000","last_became_active":"2026-02-25T15:01:50.387274+0000","last_became_peered":"2026-02-25T15:01:50.387274+0000","last_unstale":"2026-02-25T15:07:26.024758+0000","last_undegraded":"2026-02-25T15:07:26.024758+0000","last_fullsized":"2026-02-25T15:07:26.024758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:55.705403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":629,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.021593+0000","last_change":"2026-02-25T15:01:50.841299+0000","last_active":"2026-02-25T15:07:26.021593+0000","last_peered":"2026-02-25T15:07:26.021593+0000","last_clean":"2026-02-25T15:07:26.021593+0000","last_became_active":"2026-02-25T15:01:50.835823+0000","last_became_peered":"2026-02-25T15:01:50.835823+0000","last_unstale":"2026-02-25T15:07:26.021593+0000","last_undegraded":"2026-02-25T15:07:26.021593+0000","last_fullsized":"2026-02-25T15:07:26.021593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:31:50.895466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.972249+0000","last_change":"2026-02-25T15:01:50.540680+0000","last_active":"2026-02-25T15:07:25.972249+0000","last_peered":"2026-02-25T15:07:25.972249+0000","last_clean":"2026-02-25T15:07:25.972249+0000","last_became_active":"2026-02-25T15:01:50.532546+0000","last_became_peered":"2026-02-25T15:01:50.532546+0000","last_unstale":"2026-02-25T15:07:25.972249+0000","last_undegraded":"2026-02-25T15:07:25.972249+0000","last_fullsized":"2026-02-25T15:07:25.972249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:18:05.725236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.977428+0000","last_change":"2026-02-25T15:01:50.693608+0000","last_active":"2026-02-25T15:07:25.977428+0000","last_peered":"2026-02-25T15:07:25.977428+0000","last_clean":"2026-02-25T15:07:25.977428+0000","last_became_active":"2026-02-25T15:01:50.688197+0000","last_became_peered":"2026-02-25T15:01:50.688197+0000","last_unstale":"2026-02-25T15:07:25.977428+0000","last_undegraded":"2026-02-25T15:07:25.977428+0000","last_fullsized":"2026-02-25T15:07:25.977428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:32:30.363960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.990072+0000","last_change":"2026-02-25T15:01:50.782822+0000","last_active":"2026-02-25T15:07:25.990072+0000","last_peered":"2026-02-25T15:07:25.990072+0000","last_clean":"2026-02-25T15:07:25.990072+0000","last_became_active":"2026-02-25T15:01:50.780343+0000","last_became_peered":"2026-02-25T15:01:50.780343+0000","last_unstale":"2026-02-25T15:07:25.990072+0000","last_undegraded":"2026-02-25T15:07:25.990072+0000","last_fullsized":"2026-02-25T15:07:25.990072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:56:59.786199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.027807+0000","last_change":"2026-02-25T15:01:50.885131+0000","last_active":"2026-02-25T15:07:26.027807+0000","last_peered":"2026-02-25T15:07:26.027807+0000","last_clean":"2026-02-25T15:07:26.027807+0000","last_became_active":"2026-02-25T15:01:50.870593+0000","last_became_peered":"2026-02-25T15:01:50.870593+0000","last_unstale":"2026-02-25T15:07:26.027807+0000","last_undegraded":"2026-02-25T15:07:26.027807+0000","last_fullsized":"2026-02-25T15:07:26.027807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:11:54.381039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.981350+0000","last_change":"2026-02-25T15:01:51.947696+0000","last_active":"2026-02-25T15:07:25.981350+0000","last_peered":"2026-02-25T15:07:25.981350+0000","last_clean":"2026-02-25T15:07:25.981350+0000","last_became_active":"2026-02-25T15:01:51.925016+0000","last_became_peered":"2026-02-25T15:01:51.925016+0000","last_unstale":"2026-02-25T15:07:25.981350+0000","last_undegraded":"2026-02-25T15:07:25.981350+0000","last_fullsized":"2026-02-25T15:07:25.981350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:22:43.384939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.979596+0000","last_change":"2026-02-25T15:01:51.557264+0000","last_active":"2026-02-25T15:07:25.979596+0000","last_peered":"2026-02-25T15:07:25.979596+0000","last_clean":"2026-02-25T15:07:25.979596+0000","last_became_active":"2026-02-25T15:01:51.540535+0000","last_became_peered":"2026-02-25T15:01:51.540535+0000","last_unstale":"2026-02-25T15:07:25.979596+0000","last_undegraded":"2026-02-25T15:07:25.979596+0000","last_fullsized":"2026-02-25T15:07:25.979596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:23:10.989525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.961026+0000","last_change":"2026-02-25T15:01:50.882445+0000","last_active":"2026-02-25T15:07:25.961026+0000","last_peered":"2026-02-25T15:07:25.961026+0000","last_clean":"2026-02-25T15:07:25.961026+0000","last_became_active":"2026-02-25T15:01:50.877038+0000","last_became_peered":"2026-02-25T15:01:50.877038+0000","last_unstale":"2026-02-25T15:07:25.961026+0000","last_undegraded":"2026-02-25T15:07:25.961026+0000","last_fullsized":"2026-02-25T15:07:25.961026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:40.152080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.956332+0000","last_change":"2026-02-25T15:01:51.252298+0000","last_active":"2026-02-25T15:07:25.956332+0000","last_peered":"2026-02-25T15:07:25.956332+0000","last_clean":"2026-02-25T15:07:25.956332+0000","last_became_active":"2026-02-25T15:01:51.250085+0000","last_became_peered":"2026-02-25T15:01:51.250085+0000","last_unstale":"2026-02-25T15:07:25.956332+0000","last_undegraded":"2026-02-25T15:07:25.956332+0000","last_fullsized":"2026-02-25T15:07:25.956332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:04:10.324827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.114297+0000","last_change":"2026-02-25T15:07:30.114297+0000","last_active":"2026-02-25T15:07:30.114297+0000","last_peered":"2026-02-25T15:07:30.114297+0000","last_clean":"2026-02-25T15:07:30.114297+0000","last_became_active":"2026-02-25T15:01:50.455002+0000","last_became_peered":"2026-02-25T15:01:50.455002+0000","last_unstale":"2026-02-25T15:07:30.114297+0000","last_undegraded":"2026-02-25T15:07:30.114297+0000","last_fullsized":"2026-02-25T15:07:30.114297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.112571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.112571+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.112571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:21:00.888951+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.965617+0000","last_change":"2026-02-25T15:01:50.764280+0000","last_active":"2026-02-25T15:07:25.965617+0000","last_peered":"2026-02-25T15:07:25.965617+0000","last_clean":"2026-02-25T15:07:25.965617+0000","last_became_active":"2026-02-25T15:01:50.762167+0000","last_became_peered":"2026-02-25T15:01:50.762167+0000","last_unstale":"2026-02-25T15:07:25.965617+0000","last_undegraded":"2026-02-25T15:07:25.965617+0000","last_fullsized":"2026-02-25T15:07:25.965617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:04:31.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3],"acting":[13,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":632,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.957610+0000","last_change":"2026-02-25T15:01:50.542740+0000","last_active":"2026-02-25T15:07:25.957610+0000","last_peered":"2026-02-25T15:07:25.957610+0000","last_clean":"2026-02-25T15:07:25.957610+0000","last_became_active":"2026-02-25T15:01:50.536997+0000","last_became_peered":"2026-02-25T15:01:50.536997+0000","last_unstale":"2026-02-25T15:07:25.957610+0000","last_undegraded":"2026-02-25T15:07:25.957610+0000","last_fullsized":"2026-02-25T15:07:25.957610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:40:49.102479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.027542+0000","last_change":"2026-02-25T15:01:50.446794+0000","last_active":"2026-02-25T15:07:26.027542+0000","last_peered":"2026-02-25T15:07:26.027542+0000","last_clean":"2026-02-25T15:07:26.027542+0000","last_became_active":"2026-02-25T15:01:50.444694+0000","last_became_peered":"2026-02-25T15:01:50.444694+0000","last_unstale":"2026-02-25T15:07:26.027542+0000","last_undegraded":"2026-02-25T15:07:26.027542+0000","last_fullsized":"2026-02-25T15:07:26.027542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:11:26.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.979883+0000","last_change":"2026-02-25T15:01:51.582040+0000","last_active":"2026-02-25T15:07:25.979883+0000","last_peered":"2026-02-25T15:07:25.979883+0000","last_clean":"2026-02-25T15:07:25.979883+0000","last_became_active":"2026-02-25T15:01:51.576775+0000","last_became_peered":"2026-02-25T15:01:51.576775+0000","last_unstale":"2026-02-25T15:07:25.979883+0000","last_undegraded":"2026-02-25T15:07:25.979883+0000","last_fullsized":"2026-02-25T15:07:25.979883+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:10:05.577790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.984907+0000","last_change":"2026-02-25T15:01:51.716484+0000","last_active":"2026-02-25T15:07:25.984907+0000","last_peered":"2026-02-25T15:07:25.984907+0000","last_clean":"2026-02-25T15:07:25.984907+0000","last_became_active":"2026-02-25T15:01:51.713882+0000","last_became_peered":"2026-02-25T15:01:51.713882+0000","last_unstale":"2026-02-25T15:07:25.984907+0000","last_undegraded":"2026-02-25T15:07:25.984907+0000","last_fullsized":"2026-02-25T15:07:25.984907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:40:05.150346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,14],"acting":[7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.028864+0000","last_change":"2026-02-25T15:01:50.434699+0000","last_active":"2026-02-25T15:07:26.028864+0000","last_peered":"2026-02-25T15:07:26.028864+0000","last_clean":"2026-02-25T15:07:26.028864+0000","last_became_active":"2026-02-25T15:01:50.432641+0000","last_became_peered":"2026-02-25T15:01:50.432641+0000","last_unstale":"2026-02-25T15:07:26.028864+0000","last_undegraded":"2026-02-25T15:07:26.028864+0000","last_fullsized":"2026-02-25T15:07:26.028864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:59:56.267360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.430415+0000","last_change":"2026-02-25T15:07:31.430415+0000","last_active":"2026-02-25T15:07:31.430415+0000","last_peered":"2026-02-25T15:07:31.430415+0000","last_clean":"2026-02-25T15:07:31.430415+0000","last_became_active":"2026-02-25T15:01:50.366512+0000","last_became_peered":"2026-02-25T15:01:50.366512+0000","last_unstale":"2026-02-25T15:07:31.430415+0000","last_undegraded":"2026-02-25T15:07:31.430415+0000","last_fullsized":"2026-02-25T15:07:31.430415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.428645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.428645+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.428645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:33:45.758420+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.973255+0000","last_change":"2026-02-25T15:01:50.801667+0000","last_active":"2026-02-25T15:07:25.973255+0000","last_peered":"2026-02-25T15:07:25.973255+0000","last_clean":"2026-02-25T15:07:25.973255+0000","last_became_active":"2026-02-25T15:01:50.798788+0000","last_became_peered":"2026-02-25T15:01:50.798788+0000","last_unstale":"2026-02-25T15:07:25.973255+0000","last_undegraded":"2026-02-25T15:07:25.973255+0000","last_fullsized":"2026-02-25T15:07:25.973255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:05:57.793192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.364472+0000","last_change":"2026-02-25T15:07:32.364472+0000","last_active":"2026-02-25T15:07:32.364472+0000","last_peered":"2026-02-25T15:07:32.364472+0000","last_clean":"2026-02-25T15:07:32.364472+0000","last_became_active":"2026-02-25T15:01:51.516175+0000","last_became_peered":"2026-02-25T15:01:51.516175+0000","last_unstale":"2026-02-25T15:07:32.364472+0000","last_undegraded":"2026-02-25T15:07:32.364472+0000","last_fullsized":"2026-02-25T15:07:32.364472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.363034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.363034+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.363034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:00:33.187665+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,6],"acting":[12,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.990843+0000","last_change":"2026-02-25T15:01:51.024149+0000","last_active":"2026-02-25T15:07:25.990843+0000","last_peered":"2026-02-25T15:07:25.990843+0000","last_clean":"2026-02-25T15:07:25.990843+0000","last_became_active":"2026-02-25T15:01:51.015292+0000","last_became_peered":"2026-02-25T15:01:51.015292+0000","last_unstale":"2026-02-25T15:07:25.990843+0000","last_undegraded":"2026-02-25T15:07:25.990843+0000","last_fullsized":"2026-02-25T15:07:25.990843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:06:39.316850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.086392+0000","last_change":"2026-02-25T15:07:31.086392+0000","last_active":"2026-02-25T15:07:31.086392+0000","last_peered":"2026-02-25T15:07:31.086392+0000","last_clean":"2026-02-25T15:07:31.086392+0000","last_became_active":"2026-02-25T15:01:51.622021+0000","last_became_peered":"2026-02-25T15:01:51.622021+0000","last_unstale":"2026-02-25T15:07:31.086392+0000","last_undegraded":"2026-02-25T15:07:31.086392+0000","last_fullsized":"2026-02-25T15:07:31.086392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.081133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.081133+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.081133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:44:02.804797+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":633,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:26.033781+0000","last_change":"2026-02-25T15:01:50.541523+0000","last_active":"2026-02-25T15:07:26.033781+0000","last_peered":"2026-02-25T15:07:26.033781+0000","last_clean":"2026-02-25T15:07:26.033781+0000","last_became_active":"2026-02-25T15:01:50.499499+0000","last_became_peered":"2026-02-25T15:01:50.499499+0000","last_unstale":"2026-02-25T15:07:26.033781+0000","last_undegraded":"2026-02-25T15:07:26.033781+0000","last_fullsized":"2026-02-25T15:07:26.033781+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:54:45.307471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,12],"acting":[8,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.411672+0000","last_change":"2026-02-25T15:07:31.411672+0000","last_active":"2026-02-25T15:07:31.411672+0000","last_peered":"2026-02-25T15:07:31.411672+0000","last_clean":"2026-02-25T15:07:31.411672+0000","last_became_active":"2026-02-25T15:01:50.281495+0000","last_became_peered":"2026-02-25T15:01:50.281495+0000","last_unstale":"2026-02-25T15:07:31.411672+0000","last_undegraded":"2026-02-25T15:07:31.411672+0000","last_fullsized":"2026-02-25T15:07:31.411672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.409288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.409288+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.409288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.298673+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.1","version":"342'12","reported_seq":668,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.465700+0000","last_change":"2026-02-25T15:07:30.465700+0000","last_active":"2026-02-25T15:07:30.465700+0000","last_peered":"2026-02-25T15:07:30.465700+0000","last_clean":"2026-02-25T15:07:30.465700+0000","last_became_active":"2026-02-25T15:01:50.639260+0000","last_became_peered":"2026-02-25T15:01:50.639260+0000","last_unstale":"2026-02-25T15:07:30.465700+0000","last_undegraded":"2026-02-25T15:07:30.465700+0000","last_fullsized":"2026-02-25T15:07:30.465700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'12","last_scrub_stamp":"2026-02-25T15:07:30.464188+0000","last_deep_scrub":"342'12","last_deep_scrub_stamp":"2026-02-25T15:07:30.464188+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.464188+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:33:08.246962+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":631,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.957345+0000","last_change":"2026-02-25T15:01:50.710810+0000","last_active":"2026-02-25T15:07:25.957345+0000","last_peered":"2026-02-25T15:07:25.957345+0000","last_clean":"2026-02-25T15:07:25.957345+0000","last_became_active":"2026-02-25T15:01:50.708573+0000","last_became_peered":"2026-02-25T15:01:50.708573+0000","last_unstale":"2026-02-25T15:07:25.957345+0000","last_undegraded":"2026-02-25T15:07:25.957345+0000","last_fullsized":"2026-02-25T15:07:25.957345+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T21:53:45.894951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.981430+0000","last_change":"2026-02-25T15:01:51.593638+0000","last_active":"2026-02-25T15:07:25.981430+0000","last_peered":"2026-02-25T15:07:25.981430+0000","last_clean":"2026-02-25T15:07:25.981430+0000","last_became_active":"2026-02-25T15:01:51.576151+0000","last_became_peered":"2026-02-25T15:01:51.576151+0000","last_unstale":"2026-02-25T15:07:25.981430+0000","last_undegraded":"2026-02-25T15:07:25.981430+0000","last_fullsized":"2026-02-25T15:07:25.981430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:47.967956+0000","last_clean_scrub_stamp":"2026-02-25T15:01:47.967956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:22:41.062323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.457735+0000","last_change":"2026-02-25T15:07:30.457735+0000","last_active":"2026-02-25T15:07:30.457735+0000","last_peered":"2026-02-25T15:07:30.457735+0000","last_clean":"2026-02-25T15:07:30.457735+0000","last_became_active":"2026-02-25T15:01:50.713136+0000","last_became_peered":"2026-02-25T15:01:50.713136+0000","last_unstale":"2026-02-25T15:07:30.457735+0000","last_undegraded":"2026-02-25T15:07:30.457735+0000","last_fullsized":"2026-02-25T15:07:30.457735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.456906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.456906+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.456906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:26:17.529107+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":648,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.989252+0000","last_change":"2026-02-25T15:01:17.407364+0000","last_active":"2026-02-25T15:07:25.989252+0000","last_peered":"2026-02-25T15:07:25.989252+0000","last_clean":"2026-02-25T15:07:25.989252+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:07:25.989252+0000","last_undegraded":"2026-02-25T15:07:25.989252+0000","last_fullsized":"2026-02-25T15:07:25.989252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:19.167592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":656,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.353671+0000","last_change":"2026-02-25T15:07:31.353671+0000","last_active":"2026-02-25T15:07:31.353671+0000","last_peered":"2026-02-25T15:07:31.353671+0000","last_clean":"2026-02-25T15:07:31.353671+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:07:31.353671+0000","last_undegraded":"2026-02-25T15:07:31.353671+0000","last_fullsized":"2026-02-25T15:07:31.353671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.352887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.352887+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.352887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:17.346380+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":644,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.989486+0000","last_change":"2026-02-25T15:01:17.754902+0000","last_active":"2026-02-25T15:07:25.989486+0000","last_peered":"2026-02-25T15:07:25.989486+0000","last_clean":"2026-02-25T15:07:25.989486+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:07:25.989486+0000","last_undegraded":"2026-02-25T15:07:25.989486+0000","last_fullsized":"2026-02-25T15:07:25.989486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":652,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.628450+0000","last_change":"2026-02-25T15:07:32.627801+0000","last_active":"2026-02-25T15:07:32.628450+0000","last_peered":"2026-02-25T15:07:32.628450+0000","last_clean":"2026-02-25T15:07:32.628450+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:07:32.628450+0000","last_undegraded":"2026-02-25T15:07:32.628450+0000","last_fullsized":"2026-02-25T15:07:32.628450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.625968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.625968+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.625968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:53:06.519365+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":651,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.959280+0000","last_change":"2026-02-25T15:01:17.401550+0000","last_active":"2026-02-25T15:07:25.959280+0000","last_peered":"2026-02-25T15:07:25.959280+0000","last_clean":"2026-02-25T15:07:25.959280+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:07:25.959280+0000","last_undegraded":"2026-02-25T15:07:25.959280+0000","last_fullsized":"2026-02-25T15:07:25.959280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:25:49.120727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":647,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.956838+0000","last_change":"2026-02-25T15:01:17.646330+0000","last_active":"2026-02-25T15:07:25.956838+0000","last_peered":"2026-02-25T15:07:25.956838+0000","last_clean":"2026-02-25T15:07:25.956838+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:07:25.956838+0000","last_undegraded":"2026-02-25T15:07:25.956838+0000","last_fullsized":"2026-02-25T15:07:25.956838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:28:34.326329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":657,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.509118+0000","last_change":"2026-02-25T15:07:30.509118+0000","last_active":"2026-02-25T15:07:30.509118+0000","last_peered":"2026-02-25T15:07:30.509118+0000","last_clean":"2026-02-25T15:07:30.509118+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:07:30.509118+0000","last_undegraded":"2026-02-25T15:07:30.509118+0000","last_fullsized":"2026-02-25T15:07:30.509118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.503413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.503413+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.503413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:00:03.238245+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":650,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.958322+0000","last_change":"2026-02-25T15:01:17.397246+0000","last_active":"2026-02-25T15:07:25.958322+0000","last_peered":"2026-02-25T15:07:25.958322+0000","last_clean":"2026-02-25T15:07:25.958322+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:07:25.958322+0000","last_undegraded":"2026-02-25T15:07:25.958322+0000","last_fullsized":"2026-02-25T15:07:25.958322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:14.022496+0000","last_clean_scrub_stamp":"2026-02-25T15:01:14.022496+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:07:15.063185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":695,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:25.955945+0000","last_change":"2026-02-25T15:01:08.244688+0000","last_active":"2026-02-25T15:07:25.955945+0000","last_peered":"2026-02-25T15:07:25.955945+0000","last_clean":"2026-02-25T15:07:25.955945+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:07:25.955945+0000","last_undegraded":"2026-02-25T15:07:25.955945+0000","last_fullsized":"2026-02-25T15:07:25.955945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:01:06.008609+0000","last_clean_scrub_stamp":"2026-02-25T15:01:06.008609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:17:13.281739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280592,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":163,"kb_used_meta":26780,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167305,"internal_metadata":27423351},"hb_peers":[1,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34268,"kb_used_data":7308,"kb_used_omap":158,"kb_used_meta":26785,"kb_avail":94337572,"statfs":{"total":96636764160,"available":96601673728,"internally_reserved":0,"allocated":7483392,"data_stored":4761133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161981,"internal_metadata":27428675},"hb_peers":[0,1,2,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280592,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189804,"internal_metadata":27400852},"hb_peers":[0,1,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091362,"internal_metadata":24499294},"hb_peers":[1,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280591,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2505,"kb_used_meta":24438,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2566062,"internal_metadata":25024594},"hb_peers":[1,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2412,"kb_used_meta":24531,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2469949,"internal_metadata":25120707},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2461,"kb_used_meta":24482,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2520955,"internal_metadata":25069701},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218031,"internal_metadata":27372625},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34264,"kb_used_data":7304,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94337576,"statfs":{"total":96636764160,"available":96601677824,"internally_reserved":0,"allocated":7479296,"data_stored":4761128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208902,"internal_metadata":27381754},"hb_peers":[0,1,2,3,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280592,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":3016,"kb_used_meta":23927,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3088442,"internal_metadata":24502214},"hb_peers":[0,1,2,4,6,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":106,"kb_used_meta":26837,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108705,"internal_metadata":27481951},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":6856,"kb_used_omap":3018,"kb_used_meta":41973,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":7020544,"data_stored":4301867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091212,"internal_metadata":42980596},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280591,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2553,"kb_used_meta":24390,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2614680,"internal_metadata":24975976},"hb_peers":[0,1,2,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280592,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57481,"internal_metadata":27533175},"hb_peers":[1,2,3,4,5,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280591,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4301853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087368,"internal_metadata":24503288},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280592,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4301867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138997,"internal_metadata":27451659},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:07:35.781 INFO:tasks.ceph:pgid 34.1d last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.782 INFO:tasks.ceph:pgid 34.1c last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.782 INFO:tasks.ceph:pgid 34.1f last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.782 INFO:tasks.ceph:pgid 34.1e last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.782 INFO:tasks.ceph:pgid 34.19 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.782 INFO:tasks.ceph:pgid 34.18 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.1b last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.1a last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.15 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.14 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.17 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.16 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.783 INFO:tasks.ceph:pgid 34.11 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.10 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.12 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.d last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.c last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.f last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.e last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.784 INFO:tasks.ceph:pgid 34.9 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.785 INFO:tasks.ceph:pgid 34.b last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.785 INFO:tasks.ceph:pgid 34.5 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.785 INFO:tasks.ceph:pgid 34.7 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.785 INFO:tasks.ceph:pgid 34.0 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.785 INFO:tasks.ceph:pgid 34.3 last_scrub_stamp 2026-02-25T15:01:47.967956+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-25T15:01:14.022496+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-25T15:01:14.022496+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-25T15:01:14.022496+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-25T15:01:14.022496+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-25T15:01:14.022496+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=14, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-25T15:01:06.008609+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=15, tm_min=7, tm_sec=27, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T15:07:35.786 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-25T15:07:37.628 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:19.822 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.630 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:19.823 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.630 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:19.786 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.631 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:19.788 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.644 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:19.838 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.646 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:19.803 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.670 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:19.862 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.671 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:19.863 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:37.684 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:19.876 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:55.787 DEBUG:teuthology.orchestra.run.trial021:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T15:07:55.856 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 10 monclient: get_monmap_and_config 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 10 monclient: build_initial_monmap 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 10 monclient: monmap: 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:55.855168+0000 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:55.855168+0000 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:55.857 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:55.858 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:55.858 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 1 Processor -- start 2026-02-25T15:07:55.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 1 -- start start 2026-02-25T15:07:55.858 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.854+0000 7ff6c707b640 10 monclient: init 2026-02-25T15:07:55.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:55.864 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-a con 0x7ff6c0058da0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-b con 0x7ff6c00b0410 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-c con 0x7ff6c01626a0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c01655c0 con 0x7ff6c0058da0 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c00b12b0 con 0x7ff6c00b0410 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c00b1590 con 0x7ff6c01626a0 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c707b640 10 monclient(hunting): authenticate will time out at 3419.447470s 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c4df0640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff6c0058da0 0x7ff6c01647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:41918/0 (socket says 10.20.193.21:41918) 2026-02-25T15:07:55.865 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.855+0000 7ff6c4df0640 1 -- 10.20.193.21:0/2931769637 learned_addr learned my addr 10.20.193.21:0/2931769637 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940393612 0 0) 0x7ff6c00b1590 con 0x7ff6c01626a0 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): my global_id is 30989 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6ac003610 con 0x7ff6c01626a0 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481518713 0 0) 0x7ff6c01655c0 con 0x7ff6c0058da0 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.866 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): my global_id is 28353 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c00b1590 con 0x7ff6c0058da0 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188917892 0 0) 0x7ff6c00b12b0 con 0x7ff6c00b0410 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 10 monclient(hunting): my global_id is 29329 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.857+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c01655c0 con 0x7ff6c00b0410 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2317121574 0 0) 0x7ff6ac003610 con 0x7ff6c01626a0 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 >> v1:10.20.193.31:6789/0 conn(0x7ff6c00b0410 legacy=0x7ff6c0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:55.867 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 >> v1:10.20.193.21:6789/0 conn(0x7ff6c0058da0 legacy=0x7ff6c01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 monclient: found mon.noname-c 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c00b1870 con 0x7ff6c01626a0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6bc003170 con 0x7ff6c01626a0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:55.868 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6b77fe640 10 monclient: dump: 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.869 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6c707b640 5 monclient: authenticate success, global_id 30989 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.859+0000 7ff6c707b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6bc003340 con 0x7ff6c01626a0 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 1 -- 10.20.193.21:0/2931769637 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6bc003780 con 0x7ff6c01626a0 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6b77fe640 10 monclient: dump: 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.870 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 4 set_mon_vals no callback set 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 10 monclient: shutdown 2026-02-25T15:07:55.871 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 1 -- 10.20.193.21:0/2931769637 >> v1:10.20.193.68:6789/0 conn(0x7ff6c01626a0 legacy=0x7ff6c01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 1 -- 10.20.193.21:0/2931769637 shutdown_connections 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 1 -- 10.20.193.21:0/2931769637 >> 10.20.193.21:0/2931769637 conn(0x7ff6c00b65f0 msgr2=0x7ff6c00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 1 -- 10.20.193.21:0/2931769637 shutdown_connections 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 1 -- 10.20.193.21:0/2931769637 wait complete. 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 10 monclient: build_initial_monmap 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.860+0000 7ff6c707b640 10 monclient: monmap: 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:55.872 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 librados: starting msgr at 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 librados: starting objecter 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:55.873 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 Processor -- start 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 -- start start 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 librados: setting wanted keys 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 librados: calling monclient init 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient: init 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-b con 0x7ff6c0058da0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-c con 0x7ff6c00b0410 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient(hunting): picked mon.noname-a con 0x7ff6c01626a0 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c01ff260 con 0x7ff6c01626a0 2026-02-25T15:07:55.874 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c01ff540 con 0x7ff6c0058da0 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6c01ff820 con 0x7ff6c00b0410 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c707b640 10 monclient(hunting): authenticate will time out at 3419.453606s 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c55f1640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7ff6c01626a0 0x7ff6c00af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:41924/0 (socket says 10.20.193.21:41924) 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.861+0000 7ff6c55f1640 1 -- 10.20.193.21:0/1933131810 learned_addr learned my addr 10.20.193.21:0/1933131810 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter ms_handle_connect 0x7ff6c01626a0 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter ms_handle_connect 0x7ff6c0058da0 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:55.875 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter ms_handle_connect 0x7ff6c00b0410 2026-02-25T15:07:55.876 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.862+0000 7ff6b57fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061434425 0 0) 0x7ff6c01ff540 con 0x7ff6c0058da0 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): my global_id is 29332 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff690003610 con 0x7ff6c0058da0 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033342778 0 0) 0x7ff6c01ff260 con 0x7ff6c01626a0 2026-02-25T15:07:55.880 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): my global_id is 28356 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c01ff540 con 0x7ff6c01626a0 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739279325 0 0) 0x7ff6c01ff820 con 0x7ff6c00b0410 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 10 monclient(hunting): my global_id is 30992 2026-02-25T15:07:55.881 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.863+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6c01ff260 con 0x7ff6c00b0410 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 345096892 0 0) 0x7ff690003610 con 0x7ff6c0058da0 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6c01ff820 con 0x7ff6c0058da0 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6b00030b0 con 0x7ff6c0058da0 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): dump: 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.882 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2689821607 0 0) 0x7ff6c01ff260 con 0x7ff6c00b0410 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff690003610 con 0x7ff6c00b0410 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6a8003060 con 0x7ff6c00b0410 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:55.883 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.865+0000 7ff6b57fa640 10 monclient(hunting): dump: 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.884 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1559732465 0 0) 0x7ff6c01ff540 con 0x7ff6c01626a0 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6c01ff260 con 0x7ff6c01626a0 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6bc003690 con 0x7ff6c01626a0 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.866+0000 7ff6b57fa640 10 monclient(hunting): dump: 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.885 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4122251627 0 0) 0x7ff6c01ff820 con 0x7ff6c0058da0 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 >> v1:10.20.193.68:6789/0 conn(0x7ff6c00b0410 legacy=0x7ff6c01fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 >> v1:10.20.193.21:6789/0 conn(0x7ff6c01626a0 legacy=0x7ff6c00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:55.886 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 1 monclient: found mon.b 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6c01fb560 con 0x7ff6c0058da0 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 5 monclient: authenticate success, global_id 29332 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _renew_subs 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:55.887 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6c01fb840 con 0x7ff6c0058da0 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 client.29332.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _renew_subs 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff6c00afb40 con 0x7ff6c0058da0 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 1 librados: init done 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.31:6789/0 2026-02-25T15:07:55.888 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.867+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.31:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6c01658f0 con 0x7ff6c0058da0 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6b00048d0 con 0x7ff6c0058da0 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7ff6b0004c20 con 0x7ff6c0058da0 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b57fa640 10 monclient: dump: 2026-02-25T15:07:55.963 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:55.964 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.961+0000 7ff6b6ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:55.965 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.962+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7ff6b001e100 con 0x7ff6c0058da0 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.962+0000 7ff6b7fff640 10 monclient: get_auth_request con 0x7ff690079fd0 auth_method 0 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 10 client.29332.objecter ms_handle_connect 0x7ff690079fd0 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7ff6b0095ac0 con 0x7ff6c0058da0 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 10 client.29332.objecter ms_dispatch2 0x7ff6c0000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 3 client.29332.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 3 client.29332.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:55.966 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.963+0000 7ff6b57fa640 20 client.29332.objecter dump_active .. 0 homeless 2026-02-25T15:07:55.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.965+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mon.1 v1:10.20.193.31:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7ff6c01658f0 con 0x7ff6c0058da0 2026-02-25T15:07:55.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.965+0000 7ff6b57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:55.967 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:55.965+0000 7ff6b57fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:56.077 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.075+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 --> v1:10.20.193.72:6800/2463505645 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6c0055260 con 0x7ff690079fd0 2026-02-25T15:07:56.079 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.077+0000 7ff6b57fa640 1 -- 10.20.193.21:0/1933131810 <== mgr.4109 v1:10.20.193.72:6800/2463505645 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125246 (unknown 2965378022 0 2229459934) 0x7ff6c0055260 con 0x7ff690079fd0 2026-02-25T15:07:56.080 INFO:teuthology.orchestra.run.trial021.stdout: 2026-02-25T15:07:56.081 INFO:teuthology.orchestra.run.trial021.stderr:dumped all 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 10 librados: watch_flush enter 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 10 librados: watch_flush exit 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 20 client.29332.objecter shutdown clearing up homeless session... 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 10 client.29332.objecter successfully canceled tick 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 >> v1:10.20.193.72:6800/2463505645 conn(0x7ff690079fd0 legacy=0x7ff69009a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 10 monclient: shutdown 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:56.083 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 >> v1:10.20.193.31:6789/0 conn(0x7ff6c0058da0 legacy=0x7ff6c005d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 shutdown_connections 2026-02-25T15:07:56.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 >> 10.20.193.21:0/1933131810 conn(0x7ff6c00b65f0 msgr2=0x7ff6c0056db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:56.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 shutdown_connections 2026-02-25T15:07:56.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 -- 10.20.193.21:0/1933131810 wait complete. 2026-02-25T15:07:56.084 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.078+0000 7ff6c707b640 1 librados: shutdown 2026-02-25T15:07:56.089 INFO:teuthology.orchestra.run.trial021.stdout:{"pg_ready":true,"pg_map":{"version":550,"stamp":"2026-02-25T15:07:55.803061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":559960,"kb_used_data":110552,"kb_used_omap":23223,"kb_used_meta":425928,"kb_avail":1509389480,"statfs":{"total":1546188226560,"available":1545614827520,"internally_reserved":0,"allocated":113205248,"data_stored":69748176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23781236,"internal_metadata":436150412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002116"},"pg_stats":[{"pgid":"34.1d","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.848061+0000","last_change":"2026-02-25T15:07:32.848061+0000","last_active":"2026-02-25T15:07:32.848061+0000","last_peered":"2026-02-25T15:07:32.848061+0000","last_clean":"2026-02-25T15:07:32.848061+0000","last_became_active":"2026-02-25T15:01:50.928434+0000","last_became_peered":"2026-02-25T15:01:50.928434+0000","last_unstale":"2026-02-25T15:07:32.848061+0000","last_undegraded":"2026-02-25T15:07:32.848061+0000","last_fullsized":"2026-02-25T15:07:32.848061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.846242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.846242+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.846242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:25:21.174517+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.533743+0000","last_change":"2026-02-25T15:07:35.533743+0000","last_active":"2026-02-25T15:07:35.533743+0000","last_peered":"2026-02-25T15:07:35.533743+0000","last_clean":"2026-02-25T15:07:35.533743+0000","last_became_active":"2026-02-25T15:01:51.860656+0000","last_became_peered":"2026-02-25T15:01:51.860656+0000","last_unstale":"2026-02-25T15:07:35.533743+0000","last_undegraded":"2026-02-25T15:07:35.533743+0000","last_fullsized":"2026-02-25T15:07:35.533743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.532105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.532105+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.532105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:10:34.504199+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:36.326754+0000","last_change":"2026-02-25T15:07:36.326754+0000","last_active":"2026-02-25T15:07:36.326754+0000","last_peered":"2026-02-25T15:07:36.326754+0000","last_clean":"2026-02-25T15:07:36.326754+0000","last_became_active":"2026-02-25T15:01:50.970996+0000","last_became_peered":"2026-02-25T15:01:50.970996+0000","last_unstale":"2026-02-25T15:07:36.326754+0000","last_undegraded":"2026-02-25T15:07:36.326754+0000","last_fullsized":"2026-02-25T15:07:36.326754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:36.325564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:36.325564+0000","last_clean_scrub_stamp":"2026-02-25T15:07:36.325564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:29:32.152988+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.877933+0000","last_change":"2026-02-25T15:07:35.877288+0000","last_active":"2026-02-25T15:07:35.877933+0000","last_peered":"2026-02-25T15:07:35.877933+0000","last_clean":"2026-02-25T15:07:35.877933+0000","last_became_active":"2026-02-25T15:01:50.996313+0000","last_became_peered":"2026-02-25T15:01:50.996313+0000","last_unstale":"2026-02-25T15:07:35.877933+0000","last_undegraded":"2026-02-25T15:07:35.877933+0000","last_fullsized":"2026-02-25T15:07:35.877933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.876530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.876530+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.876530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:28:54.906928+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,14],"acting":[3,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.043085+0000","last_change":"2026-02-25T15:07:33.043085+0000","last_active":"2026-02-25T15:07:33.043085+0000","last_peered":"2026-02-25T15:07:33.043085+0000","last_clean":"2026-02-25T15:07:33.043085+0000","last_became_active":"2026-02-25T15:01:50.387274+0000","last_became_peered":"2026-02-25T15:01:50.387274+0000","last_unstale":"2026-02-25T15:07:33.043085+0000","last_undegraded":"2026-02-25T15:07:33.043085+0000","last_fullsized":"2026-02-25T15:07:33.043085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.041536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.041536+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.041536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:06:00.812367+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.009630+0000","last_change":"2026-02-25T15:07:32.009630+0000","last_active":"2026-02-25T15:07:32.009630+0000","last_peered":"2026-02-25T15:07:32.009630+0000","last_clean":"2026-02-25T15:07:32.009630+0000","last_became_active":"2026-02-25T15:01:50.835823+0000","last_became_peered":"2026-02-25T15:01:50.835823+0000","last_unstale":"2026-02-25T15:07:32.009630+0000","last_undegraded":"2026-02-25T15:07:32.009630+0000","last_fullsized":"2026-02-25T15:07:32.009630+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.007874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.007874+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.007874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:28:07.886962+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.372311+0000","last_change":"2026-02-25T15:07:34.372311+0000","last_active":"2026-02-25T15:07:34.372311+0000","last_peered":"2026-02-25T15:07:34.372311+0000","last_clean":"2026-02-25T15:07:34.372311+0000","last_became_active":"2026-02-25T15:01:50.532546+0000","last_became_peered":"2026-02-25T15:01:50.532546+0000","last_unstale":"2026-02-25T15:07:34.372311+0000","last_undegraded":"2026-02-25T15:07:34.372311+0000","last_fullsized":"2026-02-25T15:07:34.372311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.370448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.370448+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.370448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:34:17.842548+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.905508+0000","last_change":"2026-02-25T15:07:33.905508+0000","last_active":"2026-02-25T15:07:33.905508+0000","last_peered":"2026-02-25T15:07:33.905508+0000","last_clean":"2026-02-25T15:07:33.905508+0000","last_became_active":"2026-02-25T15:01:50.688197+0000","last_became_peered":"2026-02-25T15:01:50.688197+0000","last_unstale":"2026-02-25T15:07:33.905508+0000","last_undegraded":"2026-02-25T15:07:33.905508+0000","last_fullsized":"2026-02-25T15:07:33.905508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.904773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.904773+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.904773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:19:33.311690+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,4],"acting":[13,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:36.901563+0000","last_change":"2026-02-25T15:07:36.901563+0000","last_active":"2026-02-25T15:07:36.901563+0000","last_peered":"2026-02-25T15:07:36.901563+0000","last_clean":"2026-02-25T15:07:36.901563+0000","last_became_active":"2026-02-25T15:01:50.780343+0000","last_became_peered":"2026-02-25T15:01:50.780343+0000","last_unstale":"2026-02-25T15:07:36.901563+0000","last_undegraded":"2026-02-25T15:07:36.901563+0000","last_fullsized":"2026-02-25T15:07:36.901563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:36.900009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:36.900009+0000","last_clean_scrub_stamp":"2026-02-25T15:07:36.900009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:16:41.826709+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.495246+0000","last_change":"2026-02-25T15:07:32.495246+0000","last_active":"2026-02-25T15:07:32.495246+0000","last_peered":"2026-02-25T15:07:32.495246+0000","last_clean":"2026-02-25T15:07:32.495246+0000","last_became_active":"2026-02-25T15:01:50.870593+0000","last_became_peered":"2026-02-25T15:01:50.870593+0000","last_unstale":"2026-02-25T15:07:32.495246+0000","last_undegraded":"2026-02-25T15:07:32.495246+0000","last_fullsized":"2026-02-25T15:07:32.495246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.493292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.493292+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.493292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:24:25.573144+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.317751+0000","last_change":"2026-02-25T15:07:35.317751+0000","last_active":"2026-02-25T15:07:35.317751+0000","last_peered":"2026-02-25T15:07:35.317751+0000","last_clean":"2026-02-25T15:07:35.317751+0000","last_became_active":"2026-02-25T15:01:51.925016+0000","last_became_peered":"2026-02-25T15:01:51.925016+0000","last_unstale":"2026-02-25T15:07:35.317751+0000","last_undegraded":"2026-02-25T15:07:35.317751+0000","last_fullsized":"2026-02-25T15:07:35.317751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.316237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.316237+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.316237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:48:14.106211+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.531374+0000","last_change":"2026-02-25T15:07:34.531374+0000","last_active":"2026-02-25T15:07:34.531374+0000","last_peered":"2026-02-25T15:07:34.531374+0000","last_clean":"2026-02-25T15:07:34.531374+0000","last_became_active":"2026-02-25T15:01:51.540535+0000","last_became_peered":"2026-02-25T15:01:51.540535+0000","last_unstale":"2026-02-25T15:07:34.531374+0000","last_undegraded":"2026-02-25T15:07:34.531374+0000","last_fullsized":"2026-02-25T15:07:34.531374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.529572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.529572+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.529572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:52:20.004077+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.445807+0000","last_change":"2026-02-25T15:07:35.445807+0000","last_active":"2026-02-25T15:07:35.445807+0000","last_peered":"2026-02-25T15:07:35.445807+0000","last_clean":"2026-02-25T15:07:35.445807+0000","last_became_active":"2026-02-25T15:01:50.877038+0000","last_became_peered":"2026-02-25T15:01:50.877038+0000","last_unstale":"2026-02-25T15:07:35.445807+0000","last_undegraded":"2026-02-25T15:07:35.445807+0000","last_fullsized":"2026-02-25T15:07:35.445807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.441117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.441117+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.441117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:51:37.073519+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9],"acting":[11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.314812+0000","last_change":"2026-02-25T15:07:33.314812+0000","last_active":"2026-02-25T15:07:33.314812+0000","last_peered":"2026-02-25T15:07:33.314812+0000","last_clean":"2026-02-25T15:07:33.314812+0000","last_became_active":"2026-02-25T15:01:51.250085+0000","last_became_peered":"2026-02-25T15:01:51.250085+0000","last_unstale":"2026-02-25T15:07:33.314812+0000","last_undegraded":"2026-02-25T15:07:33.314812+0000","last_fullsized":"2026-02-25T15:07:33.314812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.313137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.313137+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.313137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:35:38.092346+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.114297+0000","last_change":"2026-02-25T15:07:30.114297+0000","last_active":"2026-02-25T15:07:30.114297+0000","last_peered":"2026-02-25T15:07:30.114297+0000","last_clean":"2026-02-25T15:07:30.114297+0000","last_became_active":"2026-02-25T15:01:50.455002+0000","last_became_peered":"2026-02-25T15:01:50.455002+0000","last_unstale":"2026-02-25T15:07:30.114297+0000","last_undegraded":"2026-02-25T15:07:30.114297+0000","last_fullsized":"2026-02-25T15:07:30.114297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.112571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.112571+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.112571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:21:00.888951+0000","scrub_duration":50,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.997804+0000","last_change":"2026-02-25T15:07:32.997804+0000","last_active":"2026-02-25T15:07:32.997804+0000","last_peered":"2026-02-25T15:07:32.997804+0000","last_clean":"2026-02-25T15:07:32.997804+0000","last_became_active":"2026-02-25T15:01:50.762167+0000","last_became_peered":"2026-02-25T15:01:50.762167+0000","last_unstale":"2026-02-25T15:07:32.997804+0000","last_undegraded":"2026-02-25T15:07:32.997804+0000","last_fullsized":"2026-02-25T15:07:32.997804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.992547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.992547+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.992547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:37:03.255641+0000","scrub_duration":102,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,3],"acting":[13,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.382101+0000","last_change":"2026-02-25T15:07:34.382101+0000","last_active":"2026-02-25T15:07:34.382101+0000","last_peered":"2026-02-25T15:07:34.382101+0000","last_clean":"2026-02-25T15:07:34.382101+0000","last_became_active":"2026-02-25T15:01:50.536997+0000","last_became_peered":"2026-02-25T15:01:50.536997+0000","last_unstale":"2026-02-25T15:07:34.382101+0000","last_undegraded":"2026-02-25T15:07:34.382101+0000","last_fullsized":"2026-02-25T15:07:34.382101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.376990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.376990+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.376990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:33:44.687966+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,10],"acting":[14,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.397438+0000","last_change":"2026-02-25T15:07:34.397438+0000","last_active":"2026-02-25T15:07:34.397438+0000","last_peered":"2026-02-25T15:07:34.397438+0000","last_clean":"2026-02-25T15:07:34.397438+0000","last_became_active":"2026-02-25T15:01:50.444694+0000","last_became_peered":"2026-02-25T15:01:50.444694+0000","last_unstale":"2026-02-25T15:07:34.397438+0000","last_undegraded":"2026-02-25T15:07:34.397438+0000","last_fullsized":"2026-02-25T15:07:34.397438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.395753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.395753+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.395753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:03:19.511982+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.170417+0000","last_change":"2026-02-25T15:07:34.170417+0000","last_active":"2026-02-25T15:07:34.170417+0000","last_peered":"2026-02-25T15:07:34.170417+0000","last_clean":"2026-02-25T15:07:34.170417+0000","last_became_active":"2026-02-25T15:01:51.576775+0000","last_became_peered":"2026-02-25T15:01:51.576775+0000","last_unstale":"2026-02-25T15:07:34.170417+0000","last_undegraded":"2026-02-25T15:07:34.170417+0000","last_fullsized":"2026-02-25T15:07:34.170417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.168657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.168657+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.168657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:04:34.529707+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,6],"acting":[10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.925885+0000","last_change":"2026-02-25T15:07:35.925885+0000","last_active":"2026-02-25T15:07:35.925885+0000","last_peered":"2026-02-25T15:07:35.925885+0000","last_clean":"2026-02-25T15:07:35.925885+0000","last_became_active":"2026-02-25T15:01:51.713882+0000","last_became_peered":"2026-02-25T15:01:51.713882+0000","last_unstale":"2026-02-25T15:07:35.925885+0000","last_undegraded":"2026-02-25T15:07:35.925885+0000","last_fullsized":"2026-02-25T15:07:35.925885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.924148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.924148+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.924148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:56:10.818379+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,14],"acting":[7,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.413988+0000","last_change":"2026-02-25T15:07:33.413988+0000","last_active":"2026-02-25T15:07:33.413988+0000","last_peered":"2026-02-25T15:07:33.413988+0000","last_clean":"2026-02-25T15:07:33.413988+0000","last_became_active":"2026-02-25T15:01:50.432641+0000","last_became_peered":"2026-02-25T15:01:50.432641+0000","last_unstale":"2026-02-25T15:07:33.413988+0000","last_undegraded":"2026-02-25T15:07:33.413988+0000","last_fullsized":"2026-02-25T15:07:33.413988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.412458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.412458+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.412458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:29:56.681307+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.430415+0000","last_change":"2026-02-25T15:07:31.430415+0000","last_active":"2026-02-25T15:07:31.430415+0000","last_peered":"2026-02-25T15:07:31.430415+0000","last_clean":"2026-02-25T15:07:31.430415+0000","last_became_active":"2026-02-25T15:01:50.366512+0000","last_became_peered":"2026-02-25T15:01:50.366512+0000","last_unstale":"2026-02-25T15:07:31.430415+0000","last_undegraded":"2026-02-25T15:07:31.430415+0000","last_fullsized":"2026-02-25T15:07:31.430415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.428645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.428645+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.428645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:33:45.758420+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":639,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.890236+0000","last_change":"2026-02-25T15:07:34.890236+0000","last_active":"2026-02-25T15:07:34.890236+0000","last_peered":"2026-02-25T15:07:34.890236+0000","last_clean":"2026-02-25T15:07:34.890236+0000","last_became_active":"2026-02-25T15:01:50.798788+0000","last_became_peered":"2026-02-25T15:01:50.798788+0000","last_unstale":"2026-02-25T15:07:34.890236+0000","last_undegraded":"2026-02-25T15:07:34.890236+0000","last_fullsized":"2026-02-25T15:07:34.890236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.885691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.885691+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.885691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:08:54.010545+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,12],"acting":[3,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.364472+0000","last_change":"2026-02-25T15:07:32.364472+0000","last_active":"2026-02-25T15:07:32.364472+0000","last_peered":"2026-02-25T15:07:32.364472+0000","last_clean":"2026-02-25T15:07:32.364472+0000","last_became_active":"2026-02-25T15:01:51.516175+0000","last_became_peered":"2026-02-25T15:01:51.516175+0000","last_unstale":"2026-02-25T15:07:32.364472+0000","last_undegraded":"2026-02-25T15:07:32.364472+0000","last_fullsized":"2026-02-25T15:07:32.364472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.363034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.363034+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.363034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:00:33.187665+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,6],"acting":[12,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":638,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.967981+0000","last_change":"2026-02-25T15:07:34.967981+0000","last_active":"2026-02-25T15:07:34.967981+0000","last_peered":"2026-02-25T15:07:34.967981+0000","last_clean":"2026-02-25T15:07:34.967981+0000","last_became_active":"2026-02-25T15:01:51.015292+0000","last_became_peered":"2026-02-25T15:01:51.015292+0000","last_unstale":"2026-02-25T15:07:34.967981+0000","last_undegraded":"2026-02-25T15:07:34.967981+0000","last_fullsized":"2026-02-25T15:07:34.967981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.963231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.963231+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.963231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:03:56.627197+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":637,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.086392+0000","last_change":"2026-02-25T15:07:31.086392+0000","last_active":"2026-02-25T15:07:31.086392+0000","last_peered":"2026-02-25T15:07:31.086392+0000","last_clean":"2026-02-25T15:07:31.086392+0000","last_became_active":"2026-02-25T15:01:51.622021+0000","last_became_peered":"2026-02-25T15:01:51.622021+0000","last_unstale":"2026-02-25T15:07:31.086392+0000","last_undegraded":"2026-02-25T15:07:31.086392+0000","last_fullsized":"2026-02-25T15:07:31.086392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.081133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.081133+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.081133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:44:02.804797+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.408265+0000","last_change":"2026-02-25T15:07:32.408265+0000","last_active":"2026-02-25T15:07:32.408265+0000","last_peered":"2026-02-25T15:07:32.408265+0000","last_clean":"2026-02-25T15:07:32.408265+0000","last_became_active":"2026-02-25T15:01:50.499499+0000","last_became_peered":"2026-02-25T15:01:50.499499+0000","last_unstale":"2026-02-25T15:07:32.408265+0000","last_undegraded":"2026-02-25T15:07:32.408265+0000","last_fullsized":"2026-02-25T15:07:32.408265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.406125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.406125+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.406125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:11:30.621746+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,12],"acting":[8,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":641,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.411672+0000","last_change":"2026-02-25T15:07:31.411672+0000","last_active":"2026-02-25T15:07:31.411672+0000","last_peered":"2026-02-25T15:07:31.411672+0000","last_clean":"2026-02-25T15:07:31.411672+0000","last_became_active":"2026-02-25T15:01:50.281495+0000","last_became_peered":"2026-02-25T15:01:50.281495+0000","last_unstale":"2026-02-25T15:07:31.411672+0000","last_undegraded":"2026-02-25T15:07:31.411672+0000","last_fullsized":"2026-02-25T15:07:31.411672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.409288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.409288+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.409288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:14:33.298673+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"34.1","version":"342'12","reported_seq":668,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.465700+0000","last_change":"2026-02-25T15:07:30.465700+0000","last_active":"2026-02-25T15:07:30.465700+0000","last_peered":"2026-02-25T15:07:30.465700+0000","last_clean":"2026-02-25T15:07:30.465700+0000","last_became_active":"2026-02-25T15:01:50.639260+0000","last_became_peered":"2026-02-25T15:01:50.639260+0000","last_unstale":"2026-02-25T15:07:30.465700+0000","last_undegraded":"2026-02-25T15:07:30.465700+0000","last_fullsized":"2026-02-25T15:07:30.465700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'12","last_scrub_stamp":"2026-02-25T15:07:30.464188+0000","last_deep_scrub":"342'12","last_deep_scrub_stamp":"2026-02-25T15:07:30.464188+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.464188+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:33:08.246962+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":640,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.541263+0000","last_change":"2026-02-25T15:07:33.540614+0000","last_active":"2026-02-25T15:07:33.541263+0000","last_peered":"2026-02-25T15:07:33.541263+0000","last_clean":"2026-02-25T15:07:33.541263+0000","last_became_active":"2026-02-25T15:01:50.708573+0000","last_became_peered":"2026-02-25T15:01:50.708573+0000","last_unstale":"2026-02-25T15:07:33.541263+0000","last_undegraded":"2026-02-25T15:07:33.541263+0000","last_fullsized":"2026-02-25T15:07:33.541263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.539752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.539752+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.539752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:18:26.686953+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":636,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:34.676931+0000","last_change":"2026-02-25T15:07:34.676931+0000","last_active":"2026-02-25T15:07:34.676931+0000","last_peered":"2026-02-25T15:07:34.676931+0000","last_clean":"2026-02-25T15:07:34.676931+0000","last_became_active":"2026-02-25T15:01:51.576151+0000","last_became_peered":"2026-02-25T15:01:51.576151+0000","last_unstale":"2026-02-25T15:07:34.676931+0000","last_undegraded":"2026-02-25T15:07:34.676931+0000","last_fullsized":"2026-02-25T15:07:34.676931+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:34.675189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:34.675189+0000","last_clean_scrub_stamp":"2026-02-25T15:07:34.675189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:33:12.532876+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":635,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.457735+0000","last_change":"2026-02-25T15:07:30.457735+0000","last_active":"2026-02-25T15:07:30.457735+0000","last_peered":"2026-02-25T15:07:30.457735+0000","last_clean":"2026-02-25T15:07:30.457735+0000","last_became_active":"2026-02-25T15:01:50.713136+0000","last_became_peered":"2026-02-25T15:01:50.713136+0000","last_unstale":"2026-02-25T15:07:30.457735+0000","last_undegraded":"2026-02-25T15:07:30.457735+0000","last_fullsized":"2026-02-25T15:07:30.457735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.456906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.456906+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.456906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:26:17.529107+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15],"acting":[4,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":657,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:37.719253+0000","last_change":"2026-02-25T15:07:37.718621+0000","last_active":"2026-02-25T15:07:37.719253+0000","last_peered":"2026-02-25T15:07:37.719253+0000","last_clean":"2026-02-25T15:07:37.719253+0000","last_became_active":"2026-02-25T15:01:15.734836+0000","last_became_peered":"2026-02-25T15:01:15.734836+0000","last_unstale":"2026-02-25T15:07:37.719253+0000","last_undegraded":"2026-02-25T15:07:37.719253+0000","last_fullsized":"2026-02-25T15:07:37.719253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:37.717207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:37.717207+0000","last_clean_scrub_stamp":"2026-02-25T15:07:37.717207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T15:16:14.246552+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.055453175,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,5],"acting":[15,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":657,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:31.354363+0000","last_change":"2026-02-25T15:07:31.353671+0000","last_active":"2026-02-25T15:07:31.354363+0000","last_peered":"2026-02-25T15:07:31.354363+0000","last_clean":"2026-02-25T15:07:31.354363+0000","last_became_active":"2026-02-25T15:01:15.420876+0000","last_became_peered":"2026-02-25T15:01:15.420876+0000","last_unstale":"2026-02-25T15:07:31.354363+0000","last_undegraded":"2026-02-25T15:07:31.354363+0000","last_fullsized":"2026-02-25T15:07:31.354363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:31.352887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:31.352887+0000","last_clean_scrub_stamp":"2026-02-25T15:07:31.352887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:41:17.346380+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.037075249999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,3],"acting":[12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":652,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:33.647199+0000","last_change":"2026-02-25T15:07:33.647199+0000","last_active":"2026-02-25T15:07:33.647199+0000","last_peered":"2026-02-25T15:07:33.647199+0000","last_clean":"2026-02-25T15:07:33.647199+0000","last_became_active":"2026-02-25T15:01:15.479491+0000","last_became_peered":"2026-02-25T15:01:15.479491+0000","last_unstale":"2026-02-25T15:07:33.647199+0000","last_undegraded":"2026-02-25T15:07:33.647199+0000","last_fullsized":"2026-02-25T15:07:33.647199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:33.645527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:33.645527+0000","last_clean_scrub_stamp":"2026-02-25T15:07:33.645527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:05:48.213151+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.043774621,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":652,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.628450+0000","last_change":"2026-02-25T15:07:32.627801+0000","last_active":"2026-02-25T15:07:32.628450+0000","last_peered":"2026-02-25T15:07:32.628450+0000","last_clean":"2026-02-25T15:07:32.628450+0000","last_became_active":"2026-02-25T15:01:15.746993+0000","last_became_peered":"2026-02-25T15:01:15.746993+0000","last_unstale":"2026-02-25T15:07:32.628450+0000","last_undegraded":"2026-02-25T15:07:32.628450+0000","last_fullsized":"2026-02-25T15:07:32.628450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:32.625968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:32.625968+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.625968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T17:53:06.519365+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.044370549000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,13],"acting":[2,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"342'3","reported_seq":660,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.692326+0000","last_change":"2026-02-25T15:07:35.692326+0000","last_active":"2026-02-25T15:07:35.692326+0000","last_peered":"2026-02-25T15:07:35.692326+0000","last_clean":"2026-02-25T15:07:35.692326+0000","last_became_active":"2026-02-25T15:01:15.489808+0000","last_became_peered":"2026-02-25T15:01:15.489808+0000","last_unstale":"2026-02-25T15:07:35.692326+0000","last_undegraded":"2026-02-25T15:07:35.692326+0000","last_fullsized":"2026-02-25T15:07:35.692326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'3","last_scrub_stamp":"2026-02-25T15:07:35.691295+0000","last_deep_scrub":"342'3","last_deep_scrub_stamp":"2026-02-25T15:07:35.691295+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.691295+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:58:23.613681+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.071892939000000003,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":655,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:35.124212+0000","last_change":"2026-02-25T15:07:35.124212+0000","last_active":"2026-02-25T15:07:35.124212+0000","last_peered":"2026-02-25T15:07:35.124212+0000","last_clean":"2026-02-25T15:07:35.124212+0000","last_became_active":"2026-02-25T15:01:15.757005+0000","last_became_peered":"2026-02-25T15:01:15.757005+0000","last_unstale":"2026-02-25T15:07:35.124212+0000","last_undegraded":"2026-02-25T15:07:35.124212+0000","last_fullsized":"2026-02-25T15:07:35.124212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:35.122741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:35.122741+0000","last_clean_scrub_stamp":"2026-02-25T15:07:35.122741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T16:03:57.155133+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.031270264999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,11],"acting":[10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":657,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:30.509118+0000","last_change":"2026-02-25T15:07:30.509118+0000","last_active":"2026-02-25T15:07:30.509118+0000","last_peered":"2026-02-25T15:07:30.509118+0000","last_clean":"2026-02-25T15:07:30.509118+0000","last_became_active":"2026-02-25T15:01:15.490754+0000","last_became_peered":"2026-02-25T15:01:15.490754+0000","last_unstale":"2026-02-25T15:07:30.509118+0000","last_undegraded":"2026-02-25T15:07:30.509118+0000","last_fullsized":"2026-02-25T15:07:30.509118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T15:07:30.503413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T15:07:30.503413+0000","last_clean_scrub_stamp":"2026-02-25T15:07:30.503413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:00:03.238245+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0.032509542000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"342'2","reported_seq":659,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:36.692435+0000","last_change":"2026-02-25T15:07:36.692435+0000","last_active":"2026-02-25T15:07:36.692435+0000","last_peered":"2026-02-25T15:07:36.692435+0000","last_clean":"2026-02-25T15:07:36.692435+0000","last_became_active":"2026-02-25T15:01:15.746083+0000","last_became_peered":"2026-02-25T15:01:15.746083+0000","last_unstale":"2026-02-25T15:07:36.692435+0000","last_undegraded":"2026-02-25T15:07:36.692435+0000","last_fullsized":"2026-02-25T15:07:36.692435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'2","last_scrub_stamp":"2026-02-25T15:07:36.690839+0000","last_deep_scrub":"342'2","last_deep_scrub_stamp":"2026-02-25T15:07:36.690839+0000","last_clean_scrub_stamp":"2026-02-25T15:07:36.690839+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:56:09.408330+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.056223267,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"1.0","version":"342'34","reported_seq":705,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-25T15:07:32.009008+0000","last_change":"2026-02-25T15:07:32.009008+0000","last_active":"2026-02-25T15:07:32.009008+0000","last_peered":"2026-02-25T15:07:32.009008+0000","last_clean":"2026-02-25T15:07:32.009008+0000","last_became_active":"2026-02-25T15:01:08.222246+0000","last_became_peered":"2026-02-25T15:01:08.222246+0000","last_unstale":"2026-02-25T15:07:32.009008+0000","last_undegraded":"2026-02-25T15:07:32.009008+0000","last_fullsized":"2026-02-25T15:07:32.009008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"342'34","last_scrub_stamp":"2026-02-25T15:07:32.004474+0000","last_deep_scrub":"342'34","last_deep_scrub_stamp":"2026-02-25T15:07:32.004474+0000","last_clean_scrub_stamp":"2026-02-25T15:07:32.004474+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:00:00.134825+0000","scrub_duration":178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":925696,"data_stored":918560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":14,"up_from":22,"seq":94489280596,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":163,"kb_used_meta":26780,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167305,"internal_metadata":27423351},"hb_peers":[1,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280596,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34268,"kb_used_data":7308,"kb_used_omap":158,"kb_used_meta":26785,"kb_avail":94337572,"statfs":{"total":96636764160,"available":96601673728,"internally_reserved":0,"allocated":7483392,"data_stored":4761133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":161981,"internal_metadata":27428675},"hb_peers":[0,1,2,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280596,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":185,"kb_used_meta":26758,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":189804,"internal_metadata":27400852},"hb_peers":[0,1,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313300,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091362,"internal_metadata":24499294},"hb_peers":[1,3,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280595,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2505,"kb_used_meta":24438,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2566062,"internal_metadata":25024594},"hb_peers":[1,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313299,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2412,"kb_used_meta":24531,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2469949,"internal_metadata":25120707},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2461,"kb_used_meta":24482,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2520955,"internal_metadata":25069701},"hb_peers":[0,1,2,3,5,6,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313300,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218031,"internal_metadata":27372625},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34264,"kb_used_data":7304,"kb_used_omap":204,"kb_used_meta":26739,"kb_avail":94337576,"statfs":{"total":96636764160,"available":96601677824,"internally_reserved":0,"allocated":7479296,"data_stored":4761128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":208902,"internal_metadata":27381754},"hb_peers":[0,1,2,3,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280596,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":3016,"kb_used_meta":23927,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3088442,"internal_metadata":24502214},"hb_peers":[0,1,2,4,6,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280596,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":106,"kb_used_meta":26837,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108705,"internal_metadata":27481951},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280596,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51864,"kb_used_data":6856,"kb_used_omap":3018,"kb_used_meta":41973,"kb_avail":94319976,"statfs":{"total":96636764160,"available":96583655424,"internally_reserved":0,"allocated":7020544,"data_stored":4301867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3091212,"internal_metadata":42980596},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280595,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":2553,"kb_used_meta":24390,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2614680,"internal_metadata":24975976},"hb_peers":[0,1,2,4,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280596,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":56,"kb_used_meta":26887,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4301848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57481,"internal_metadata":27533175},"hb_peers":[1,2,3,4,5,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":22,"seq":94489280595,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":3015,"kb_used_meta":23928,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4301853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3087368,"internal_metadata":24503288},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280596,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":135,"kb_used_meta":26808,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4301867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":138997,"internal_metadata":27451659},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":459280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T15:07:56.095 DEBUG:teuthology.orchestra.run.trial021:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 10 monclient: get_monmap_and_config 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 10 monclient: build_initial_monmap 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 10 monclient: monmap: 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T15:07:56.162765+0000 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T15:07:56.162765+0000 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:56.164 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.165 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:56.165 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:56.165 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:56.165 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 1 Processor -- start 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 1 -- start start 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.162+0000 7f1347216640 10 monclient: init 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient(hunting): picked mon.noname-b con 0x7f134015d2e0 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:56.167 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient(hunting): picked mon.noname-a con 0x7f13400b5d10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient(hunting): picked mon.noname-c con 0x7f13401a7990 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13400b26a0 con 0x7f13400b5d10 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13400b2980 con 0x7f134015d2e0 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13400afd20 con 0x7f13401a7990 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1347216640 10 monclient(hunting): authenticate will time out at 3419.755199s 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1337fff640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f13400b5d10 0x7f13400b0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:41930/0 (socket says 10.20.193.21:41930) 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.163+0000 7f1337fff640 1 -- 10.20.193.21:0/3998547340 learned_addr learned my addr 10.20.193.21:0/3998547340 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353806135 0 0) 0x7f13400afd20 con 0x7f13401a7990 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.168 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): my global_id is 30995 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f132c003610 con 0x7f13401a7990 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101919819 0 0) 0x7f13400b26a0 con 0x7f13400b5d10 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): my global_id is 28359 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13400afd20 con 0x7f13400b5d10 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044062653 0 0) 0x7f13400b2980 con 0x7f134015d2e0 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.169 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 10 monclient(hunting): my global_id is 29335 2026-02-25T15:07:56.170 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.165+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13400b26a0 con 0x7f134015d2e0 2026-02-25T15:07:56.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559466928 0 0) 0x7f132c003610 con 0x7f13401a7990 2026-02-25T15:07:56.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 >> v1:10.20.193.31:6789/0 conn(0x7f134015d2e0 legacy=0x7f1340163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.175 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 >> v1:10.20.193.21:6789/0 conn(0x7f13400b5d10 legacy=0x7f13400b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: _finish_hunting 0 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 monclient: found mon.noname-c 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13400b0000 con 0x7f13401a7990 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: _finish_auth 0 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: _check_auth_tickets 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f133c003170 con 0x7f13401a7990 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:56.176 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f13377fe640 10 monclient: dump: 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f1347216640 5 monclient: authenticate success, global_id 30995 2026-02-25T15:07:56.177 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.166+0000 7f1347216640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.2 v1:10.20.193.68:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f133c003340 con 0x7f13401a7990 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 1 -- 10.20.193.21:0/3998547340 <== mon.2 v1:10.20.193.68:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f133c003780 con 0x7f13401a7990 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f1347216640 10 monclient: get_monmap_and_config success 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f1347216640 4 set_mon_vals no callback set 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.167+0000 7f13377fe640 10 monclient: dump: 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.178 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 10 monclient: shutdown 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- 10.20.193.21:0/3998547340 >> v1:10.20.193.68:6789/0 conn(0x7f13401a7990 legacy=0x7f13401c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- 10.20.193.21:0/3998547340 shutdown_connections 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- 10.20.193.21:0/3998547340 >> 10.20.193.21:0/3998547340 conn(0x7f13400b5200 msgr2=0x7f13400b5600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- 10.20.193.21:0/3998547340 shutdown_connections 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- 10.20.193.21:0/3998547340 wait complete. 2026-02-25T15:07:56.179 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 10 monclient: build_initial_monmap 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 10 monclient: monmap: 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:epoch 0 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 0.000000 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:created 0.000000 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 0 (unknown) 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 1 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.noname-a 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.noname-b 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.noname-c 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.180 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 librados: starting msgr at 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 librados: starting objecter 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 20 client.?.objecter Objecter: read policy: balance 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 Processor -- start 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 -- start start 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 librados: setting wanted keys 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 1 librados: calling monclient init 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.168+0000 7f1347216640 10 monclient: init 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient: _reopen_session rank -1 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient(hunting): picked mon.noname-a con 0x7f13400b5d10 addr v1:10.20.193.21:6789/0 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient(hunting): picked mon.noname-c con 0x7f134015d2e0 addr v1:10.20.193.68:6789/0 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient(hunting): picked mon.noname-b con 0x7f13401a7990 addr v1:10.20.193.31:6789/0 2026-02-25T15:07:56.181 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 1 -- --> v1:10.20.193.21:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13400b8080 con 0x7f13400b5d10 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 1 -- --> v1:10.20.193.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13401962b0 con 0x7f13401a7990 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1340196590 con 0x7f134015d2e0 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient(hunting): _renew_subs 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1347216640 10 monclient(hunting): authenticate will time out at 3419.761278s 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1344f8b640 1 --1- >> v1:10.20.193.21:6789/0 conn(0x7f13400b5d10 0x7f134012a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.21:6789/0 says I am v1:10.20.193.21:41936/0 (socket says 10.20.193.21:41936) 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f1344f8b640 1 -- 10.20.193.21:0/4001955648 learned_addr learned my addr 10.20.193.21:0/4001955648 (peer_addr_for_me v1:10.20.193.21:0/0) 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter ms_handle_connect 0x7f13400b5d10 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter ms_handle_connect 0x7f134015d2e0 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter ms_handle_connect 0x7f13401a7990 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.169+0000 7f13357fa640 10 client.?.objecter resend_mon_ops 2026-02-25T15:07:56.182 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.0 v1:10.20.193.21:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919812541 0 0) 0x7f13400b8080 con 0x7f13400b5d10 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): my global_id is 28362 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.21:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1310003610 con 0x7f13400b5d10 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 315815273 0 0) 0x7f1340196590 con 0x7f134015d2e0 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): my global_id is 30998 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13400b8080 con 0x7f134015d2e0 2026-02-25T15:07:56.183 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.1 v1:10.20.193.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1185684861 0 0) 0x7f13401962b0 con 0x7f13401a7990 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _negotiate 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth method 2 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 10 monclient(hunting): my global_id is 29338 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.170+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1340196590 con 0x7f13401a7990 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2350164872 0 0) 0x7f13400b8080 con 0x7f134015d2e0 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13401962b0 con 0x7f134015d2e0 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1328002ff0 con 0x7f134015d2e0 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): dump: 2026-02-25T15:07:56.184 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): _finish_auth 0 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.0 v1:10.20.193.21:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1389253677 0 0) 0x7f1310003610 con 0x7f13400b5d10 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.21:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13400b8080 con 0x7f13400b5d10 2026-02-25T15:07:56.185 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.0 v1:10.20.193.21:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f13300030c0 con 0x7f13400b5d10 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): dump: 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.186 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.1 v1:10.20.193.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2601864212 0 0) 0x7f1340196590 con 0x7f13401a7990 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.31:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1310003610 con 0x7f13401a7990 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.1 v1:10.20.193.31:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f133c0034f0 con 0x7f13401a7990 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.173+0000 7f13357fa640 10 monclient(hunting): dump: 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.187 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.188 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.188 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.188 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.189 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 425099534 0 0) 0x7f13401962b0 con 0x7f134015d2e0 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 >> v1:10.20.193.31:6789/0 conn(0x7f13401a7990 legacy=0x7f134005a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 >> v1:10.20.193.21:6789/0 conn(0x7f13400b5d10 legacy=0x7f134012a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 10 monclient: _finish_hunting 0 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 1 monclient: found mon.c 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1340196870 con 0x7f134015d2e0 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 10 monclient: _finish_auth 0 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 10 monclient: _check_auth_tickets 2026-02-25T15:07:56.190 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f13357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 5 monclient: authenticate success, global_id 30998 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 10 monclient: _renew_subs 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1340196b50 con 0x7f134015d2e0 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 10 client.30998.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 10 monclient: _renew_subs 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1340197630 con 0x7f134015d2e0 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.174+0000 7f1347216640 1 librados: init done 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.175+0000 7f1347216640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.175+0000 7f1347216640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.175+0000 7f1347216640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.191 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.175+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134005bc00 con 0x7f134015d2e0 2026-02-25T15:07:56.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1328003190 con 0x7f134015d2e0 2026-02-25T15:07:56.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 10 monclient: handle_config config(0 keys) 2026-02-25T15:07:56.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1050439073 0 0) 0x7f1328004a70 con 0x7f134015d2e0 2026-02-25T15:07:56.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-25T15:07:56.266 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f13357fa640 10 monclient: dump: 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:epoch 1 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:fsid 78eb62b3-faf7-40dd-bfaf-5abbadd7c17c 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:last_changed 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:created 2026-02-25T14:59:50.231561+0000 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:min_mon_release 20 (tentacle) 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:election_strategy: 3 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:0: v1:10.20.193.21:6789/0 mon.a 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:1: v1:10.20.193.31:6789/0 mon.b 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2: v1:10.20.193.68:6789/0 mon.c 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.264+0000 7f1336ffd640 4 set_mon_vals no callback set 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.265+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 979357469 0 0) 0x7f132801df50 con 0x7f134015d2e0 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.266+0000 7f1344f8b640 10 monclient: get_auth_request con 0x7f1310079ff0 auth_method 0 2026-02-25T15:07:56.267 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.266+0000 7f13357fa640 10 client.30998.objecter ms_handle_connect 0x7f1310079ff0 2026-02-25T15:07:56.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.267+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 8 ==== osd_map(342..342 src has 1..342) ==== 8955+0+0 (unknown 2410101390 0 0) 0x7f1328095c10 con 0x7f134015d2e0 2026-02-25T15:07:56.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.267+0000 7f13357fa640 10 client.30998.objecter ms_dispatch2 0x7f1340000b90 osd_map(342..342 src has 1..342) 2026-02-25T15:07:56.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.267+0000 7f13357fa640 3 client.30998.objecter handle_osd_map got epochs [342,342] > 0 2026-02-25T15:07:56.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.267+0000 7f13357fa640 3 client.30998.objecter handle_osd_map decoding full epoch 342 2026-02-25T15:07:56.269 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.267+0000 7f13357fa640 20 client.30998.objecter dump_active .. 0 homeless 2026-02-25T15:07:56.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.269+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232701 (unknown 1092875540 0 2851345850) 0x7f132805f570 con 0x7f134015d2e0 2026-02-25T15:07:56.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.269+0000 7f13357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-25T15:07:56.271 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.269+0000 7f13357fa640 10 monclient: _finish_command 1 = system:0 2026-02-25T15:07:56.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.377+0000 7f1347216640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:07:56.379 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.377+0000 7f1347216640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:07:56.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.377+0000 7f1347216640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.68:6789/0 2026-02-25T15:07:56.380 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.377+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 --> v1:10.20.193.68:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f13400b4650 con 0x7f134015d2e0 2026-02-25T15:07:56.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.433+0000 7f13357fa640 1 -- 10.20.193.21:0/4001955648 <== mon.2 v1:10.20.193.68:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f132805ee70 con 0x7f134015d2e0 2026-02-25T15:07:56.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.433+0000 7f13357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-25T15:07:56.434 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.433+0000 7f13357fa640 10 monclient: _finish_command 2 = system:0 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 10 librados: watch_flush enter 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 10 librados: watch_flush exit 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 20 client.30998.objecter shutdown clearing up homeless session... 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 10 client.30998.objecter successfully canceled tick 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 >> v1:10.20.193.72:6800/2463505645 conn(0x7f1310079ff0 legacy=0x7f131009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 10 monclient: shutdown 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 >> v1:10.20.193.68:6789/0 conn(0x7f134015d2e0 legacy=0x7f13400b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 shutdown_connections 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 >> 10.20.193.21:0/4001955648 conn(0x7f13400b5200 msgr2=0x7f13401a71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 shutdown_connections 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 -- 10.20.193.21:0/4001955648 wait complete. 2026-02-25T15:07:56.436 INFO:teuthology.orchestra.run.trial021.stderr:2026-02-25T15:07:56.434+0000 7f1347216640 1 librados: shutdown 2026-02-25T15:07:56.445 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-25T15:07:56.445 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-25T15:07:56.446 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T15:07:56.446 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:07:56.453 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:07:56.447+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 45456) UID: 0 2026-02-25T15:07:56.453 INFO:tasks.ceph.osd.0.trial021.stderr:2026-02-25T15:07:56.447+0000 c763640 -1 osd.0 342 *** Got signal Terminated *** 2026-02-25T15:07:57.681 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:39.837 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.708 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:39.865 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.717 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:39.874 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.733 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:39.925 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.735 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:39.927 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.738 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:39.932 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.741 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:39.935 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.743 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:39.935 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:07:57.751 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:39.945 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:02.548 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T15:08:02.548 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-25T15:08:02.548 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:02.554 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:08:02.549+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 45458) UID: 0 2026-02-25T15:08:02.554 INFO:tasks.ceph.osd.4.trial021.stderr:2026-02-25T15:08:02.549+0000 c763640 -1 osd.4 344 *** Got signal Terminated *** 2026-02-25T15:08:08.649 INFO:tasks.ceph.osd.4:Stopped 2026-02-25T15:08:08.650 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-25T15:08:08.650 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:08.657 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:08:08.651+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 45462) UID: 0 2026-02-25T15:08:08.657 INFO:tasks.ceph.osd.8.trial021.stderr:2026-02-25T15:08:08.651+0000 c763640 -1 osd.8 346 *** Got signal Terminated *** 2026-02-25T15:08:11.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-25T15:08:14.751 INFO:tasks.ceph.osd.8:Stopped 2026-02-25T15:08:14.752 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-25T15:08:14.752 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:14.759 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:08:14.753+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 45464) UID: 0 2026-02-25T15:08:14.759 INFO:tasks.ceph.osd.12.trial021.stderr:2026-02-25T15:08:14.754+0000 c763640 -1 osd.12 348 *** Got signal Terminated *** 2026-02-25T15:08:17.690 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:59.884 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.691 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:59.848 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.693 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:59.886 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.694 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:59.851 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.703 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:07:59.897 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.704 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:07:59.862 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.721 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:59.913 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.723 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:59.915 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:17.734 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:07:59.926 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:18.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2026-02-25T15:08:18.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-25T15:08:20.854 INFO:tasks.ceph.osd.12:Stopped 2026-02-25T15:08:20.854 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T15:08:20.854 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:20.861 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:08:20.855+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 45044) UID: 0 2026-02-25T15:08:20.861 INFO:tasks.ceph.osd.1.trial031.stderr:2026-02-25T15:08:20.856+0000 c763640 -1 osd.1 350 *** Got signal Terminated *** 2026-02-25T15:08:25.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-25T15:08:25.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2026-02-25T15:08:26.956 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T15:08:26.957 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-25T15:08:26.957 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:26.964 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:08:26.958+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 45050) UID: 0 2026-02-25T15:08:26.965 INFO:tasks.ceph.osd.5.trial031.stderr:2026-02-25T15:08:26.959+0000 c763640 -1 osd.5 352 *** Got signal Terminated *** 2026-02-25T15:08:31.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2026-02-25T15:08:31.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-25T15:08:33.058 INFO:tasks.ceph.osd.5:Stopped 2026-02-25T15:08:33.059 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-25T15:08:33.059 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:33.065 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:08:33.060+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 45053) UID: 0 2026-02-25T15:08:33.066 INFO:tasks.ceph.osd.9.trial031.stderr:2026-02-25T15:08:33.061+0000 c763640 -1 osd.9 354 *** Got signal Terminated *** 2026-02-25T15:08:37.807 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:19.964 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.809 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:19.966 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.821 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:19.978 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.832 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:20.026 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.833 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:20.024 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.833 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:20.027 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.834 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:20.026 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.846 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:20.039 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:37.846 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:20.038 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:38.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-25T15:08:38.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2026-02-25T15:08:39.161 INFO:tasks.ceph.osd.9:Stopped 2026-02-25T15:08:39.161 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-25T15:08:39.162 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:39.169 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:08:39.163+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 45055) UID: 0 2026-02-25T15:08:39.169 INFO:tasks.ceph.osd.13.trial031.stderr:2026-02-25T15:08:39.164+0000 c763640 -1 osd.13 356 *** Got signal Terminated *** 2026-02-25T15:08:44.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-25T15:08:44.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2026-02-25T15:08:45.263 INFO:tasks.ceph.osd.13:Stopped 2026-02-25T15:08:45.264 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T15:08:45.264 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:45.272 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:08:45.265+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 45185) UID: 0 2026-02-25T15:08:45.272 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-25T15:08:45.266+0000 c763640 -1 osd.2 358 *** Got signal Terminated *** 2026-02-25T15:08:50.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-25T15:08:50.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-25T15:08:51.366 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T15:08:51.367 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-25T15:08:51.367 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:08:51.374 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:08:51.368+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 45189) UID: 0 2026-02-25T15:08:51.375 INFO:tasks.ceph.osd.6.trial068.stderr:2026-02-25T15:08:51.369+0000 c763640 -1 osd.6 360 *** Got signal Terminated *** 2026-02-25T15:08:57.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-25T15:08:57.789 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:39.946 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.795 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:39.952 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.807 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:39.963 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.814 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:40.006 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.815 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:40.008 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.815 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:40.009 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.816 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:40.007 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.825 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:08:40.019 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:08:57.827 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:08:40.019 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:03.576 INFO:tasks.ceph.osd.6:Stopped 2026-02-25T15:09:03.576 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-25T15:09:03.576 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:03.623 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:09:03.617+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 45192) UID: 0 2026-02-25T15:09:03.623 INFO:tasks.ceph.osd.10.trial068.stderr:2026-02-25T15:09:03.618+0000 c763640 -1 osd.10 362 *** Got signal Terminated *** 2026-02-25T15:09:09.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-25T15:09:09.677 INFO:tasks.ceph.osd.10:Stopped 2026-02-25T15:09:09.677 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-25T15:09:09.677 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:09.684 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:09:09.678+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 45194) UID: 0 2026-02-25T15:09:09.684 INFO:tasks.ceph.osd.14.trial068.stderr:2026-02-25T15:09:09.679+0000 c763640 -1 osd.14 364 *** Got signal Terminated *** 2026-02-25T15:09:15.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-25T15:09:15.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-25T15:09:15.779 INFO:tasks.ceph.osd.14:Stopped 2026-02-25T15:09:15.779 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-25T15:09:15.780 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:15.797 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:09:15.790+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 45701) UID: 0 2026-02-25T15:09:15.798 INFO:tasks.ceph.osd.3.trial072.stderr:2026-02-25T15:09:15.791+0000 c763640 -1 osd.3 366 *** Got signal Terminated *** 2026-02-25T15:09:17.817 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:59.974 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.818 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:00.011 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.818 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:59.975 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.819 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:00.012 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.827 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:00.021 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.828 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:08:59.985 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.843 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:00.035 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.845 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:00.037 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:17.854 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:00.046 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:20.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-25T15:09:20.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-25T15:09:21.882 INFO:tasks.ceph.osd.3:Stopped 2026-02-25T15:09:21.882 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-25T15:09:21.882 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:21.890 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:09:21.882+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 45703) UID: 0 2026-02-25T15:09:21.890 INFO:tasks.ceph.osd.7.trial072.stderr:2026-02-25T15:09:21.883+0000 c763640 -1 osd.7 366 *** Got signal Terminated *** 2026-02-25T15:09:26.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-25T15:09:32.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-25T15:09:34.086 INFO:tasks.ceph.osd.7:Stopped 2026-02-25T15:09:34.087 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-25T15:09:34.087 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:34.095 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:09:34.088+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 45706) UID: 0 2026-02-25T15:09:34.096 INFO:tasks.ceph.osd.11.trial072.stderr:2026-02-25T15:09:34.089+0000 c763640 -1 osd.11 366 *** Got signal Terminated *** 2026-02-25T15:09:37.847 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:09:20.004 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.848 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:20.042 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.849 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:09:20.006 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.850 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:20.044 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.857 INFO:tasks.ceph.mon.c.trial068.stderr:==00:00:09:20.014 44953== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.858 INFO:tasks.ceph.mon.a.trial021.stderr:==00:00:09:20.052 45070== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.876 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:20.068 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.876 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:20.068 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:37.885 INFO:tasks.ceph.mon.b.trial031.stderr:==00:00:09:20.077 44814== Warning: unimplemented fcntl command: 1036 2026-02-25T15:09:38.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-25T15:09:40.189 INFO:tasks.ceph.osd.11:Stopped 2026-02-25T15:09:40.189 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-25T15:09:40.189 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:40.196 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:09:40.189+0000 c763640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 45709) UID: 0 2026-02-25T15:09:40.197 INFO:tasks.ceph.osd.15.trial072.stderr:2026-02-25T15:09:40.190+0000 c763640 -1 osd.15 366 *** Got signal Terminated *** 2026-02-25T15:09:43.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-25T15:09:46.291 INFO:tasks.ceph.osd.15:Stopped 2026-02-25T15:09:46.291 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-25T15:09:46.292 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-25T15:09:46.292 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:46.324 INFO:tasks.ceph.mgr.y:Stopped 2026-02-25T15:09:46.324 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T15:09:46.325 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:46.325 INFO:tasks.ceph.mgr.x.trial072.stderr:2026-02-25T15:09:46.322+0000 7fc677f69640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 44643) UID: 0 2026-02-25T15:09:46.325 INFO:tasks.ceph.mgr.x.trial072.stderr:2026-02-25T15:09:46.322+0000 7fc677f69640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-25T15:09:46.359 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T15:09:46.359 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-25T15:09:46.359 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T15:09:46.360 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:46.372 INFO:tasks.ceph.mon.a.trial021.stderr:2026-02-25T15:09:46.365+0000 add5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 45068) UID: 0 2026-02-25T15:09:46.372 INFO:tasks.ceph.mon.a.trial021.stderr:2026-02-25T15:09:46.366+0000 add5640 -1 mon.a@0(peon) e1 *** Got Signal Terminated *** 2026-02-25T15:09:48.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-25T15:09:48.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-25T15:09:52.461 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T15:09:52.461 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-25T15:09:52.462 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:52.469 INFO:tasks.ceph.mon.b.trial031.stderr:2026-02-25T15:09:52.463+0000 add5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44812) UID: 0 2026-02-25T15:09:52.471 INFO:tasks.ceph.mon.b.trial031.stderr:2026-02-25T15:09:52.463+0000 add5640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-25T15:09:53.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-25T15:09:53.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-25T15:09:58.563 INFO:tasks.ceph.mon.b:Stopped 2026-02-25T15:09:58.564 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-25T15:09:58.564 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-25T15:09:58.572 INFO:tasks.ceph.mon.c.trial068.stderr:2026-02-25T15:09:58.565+0000 add5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44951) UID: 0 2026-02-25T15:09:58.572 INFO:tasks.ceph.mon.c.trial068.stderr:2026-02-25T15:09:58.565+0000 add5640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-25T15:09:58.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-25T15:09:58.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-25T15:10:03.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2026-02-25T15:10:04.666 INFO:tasks.ceph.mon.c:Stopped 2026-02-25T15:10:04.666 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-25T15:10:04.667 DEBUG:teuthology.orchestra.run.trial021:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-25T15:10:04.697 INFO:teuthology.orchestra.run.trial021.stdout:2026-02-25T15:02:26.836819+0000 mon.c (mon.2) 473 : cluster [WRN] Health check failed: 1 network partition detected (MON_NETSPLIT) 2026-02-25T15:10:04.698 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-25T15:10:04.699 DEBUG:teuthology.orchestra.run.trial021:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-25T15:10:04.766 DEBUG:teuthology.orchestra.run.trial021:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-25T15:10:04.833 DEBUG:teuthology.orchestra.run.trial021:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-25T15:10:04.899 INFO:teuthology.orchestra.run.trial021.stdout:2026-02-25T15:02:26.836819+0000 mon.c (mon.2) 473 : cluster [WRN] Health check failed: 1 network partition detected (MON_NETSPLIT) 2026-02-25T15:10:04.900 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T15:10:04.900 DEBUG:teuthology.orchestra.run.trial021:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-25T15:10:04.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T15:10:04.975 DEBUG:teuthology.orchestra.run.trial021:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-25T15:10:05.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T15:10:05.049 DEBUG:teuthology.orchestra.run.trial021:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-25T15:10:05.118 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial021.front.sepia.ceph.com 2026-02-25T15:10:05.118 DEBUG:teuthology.orchestra.run.trial021:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-25T15:10:05.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T15:10:05.210 DEBUG:teuthology.orchestra.run.trial031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-25T15:10:05.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T15:10:05.265 DEBUG:teuthology.orchestra.run.trial031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-25T15:10:05.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T15:10:05.301 DEBUG:teuthology.orchestra.run.trial031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-25T15:10:05.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial031.front.sepia.ceph.com 2026-02-25T15:10:05.371 DEBUG:teuthology.orchestra.run.trial031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-25T15:10:05.441 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:10:05.441 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-25T15:10:05.491 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:10:05.492 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-25T15:10:05.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:10:05.527 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-25T15:10:05.596 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:10:05.596 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-25T15:10:05.669 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:10:05.669 DEBUG:teuthology.orchestra.run.trial072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-25T15:10:05.719 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:10:05.719 DEBUG:teuthology.orchestra.run.trial072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-25T15:10:05.754 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:10:05.754 DEBUG:teuthology.orchestra.run.trial072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-25T15:10:05.825 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:10:05.825 DEBUG:teuthology.orchestra.run.trial072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-25T15:10:05.899 INFO:tasks.ceph:Archiving mon data... 2026-02-25T15:10:05.901 DEBUG:teuthology.misc:Transferring archived files from trial021:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/data/mon.a.tgz 2026-02-25T15:10:05.902 DEBUG:teuthology.orchestra.run.trial021:> mktemp 2026-02-25T15:10:05.919 INFO:teuthology.orchestra.run.trial021.stdout:/tmp/tmp.cMFYXSlzBF 2026-02-25T15:10:05.920 DEBUG:teuthology.orchestra.run.trial021:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cMFYXSlzBF 2026-02-25T15:10:06.100 DEBUG:teuthology.orchestra.run.trial021:> sudo chmod 0666 /tmp/tmp.cMFYXSlzBF 2026-02-25T15:10:06.183 DEBUG:teuthology.orchestra.remote:trial021:/tmp/tmp.cMFYXSlzBF is 938KB 2026-02-25T15:10:06.303 DEBUG:teuthology.orchestra.run.trial021:> rm -fr /tmp/tmp.cMFYXSlzBF 2026-02-25T15:10:06.321 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/data/mon.b.tgz 2026-02-25T15:10:06.322 DEBUG:teuthology.orchestra.run.trial031:> mktemp 2026-02-25T15:10:06.340 INFO:teuthology.orchestra.run.trial031.stdout:/tmp/tmp.7yibJ8gT1d 2026-02-25T15:10:06.340 DEBUG:teuthology.orchestra.run.trial031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7yibJ8gT1d 2026-02-25T15:10:06.519 DEBUG:teuthology.orchestra.run.trial031:> sudo chmod 0666 /tmp/tmp.7yibJ8gT1d 2026-02-25T15:10:06.602 DEBUG:teuthology.orchestra.remote:trial031:/tmp/tmp.7yibJ8gT1d is 938KB 2026-02-25T15:10:06.705 DEBUG:teuthology.orchestra.run.trial031:> rm -fr /tmp/tmp.7yibJ8gT1d 2026-02-25T15:10:06.723 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/data/mon.c.tgz 2026-02-25T15:10:06.723 DEBUG:teuthology.orchestra.run.trial068:> mktemp 2026-02-25T15:10:06.741 INFO:teuthology.orchestra.run.trial068.stdout:/tmp/tmp.Q3WIewEQjD 2026-02-25T15:10:06.742 DEBUG:teuthology.orchestra.run.trial068:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Q3WIewEQjD 2026-02-25T15:10:06.923 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0666 /tmp/tmp.Q3WIewEQjD 2026-02-25T15:10:07.004 DEBUG:teuthology.orchestra.remote:trial068:/tmp/tmp.Q3WIewEQjD is 938KB 2026-02-25T15:10:07.108 DEBUG:teuthology.orchestra.run.trial068:> rm -fr /tmp/tmp.Q3WIewEQjD 2026-02-25T15:10:07.125 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-25T15:10:07.126 DEBUG:teuthology.orchestra.run.trial021:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:10:07.129 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:10:07.132 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:10:07.166 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T15:10:07.453 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:10:07.710 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:10:07.967 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:10:08.181 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-25T15:10:08.181 INFO:tasks.ceph:Archiving crash dumps... 2026-02-25T15:10:08.184 DEBUG:teuthology.misc:Transferring archived files from trial021:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial021/crash 2026-02-25T15:10:08.185 DEBUG:teuthology.orchestra.run.trial021:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:10:08.212 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial031/crash 2026-02-25T15:10:08.214 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:10:08.241 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial068/crash 2026-02-25T15:10:08.242 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:10:08.270 DEBUG:teuthology.misc:Transferring archived files from trial072:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial072/crash 2026-02-25T15:10:08.271 DEBUG:teuthology.orchestra.run.trial072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T15:10:08.297 INFO:tasks.ceph:Compressing logs... 2026-02-25T15:10:08.298 DEBUG:teuthology.orchestra.run.trial021:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:08.301 DEBUG:teuthology.orchestra.run.trial031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:08.304 DEBUG:teuthology.orchestra.run.trial068:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:08.316 DEBUG:teuthology.orchestra.run.trial072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-25T15:10:08.333 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/valgrind/osd.9.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 90.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:10:08.334 INFO:teuthology.orchestra.run.trial031.stderr: 91.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:10:08.350 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-25T15:10:08.350 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-25T15:10:08.350 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-25T15:10:08.350 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-25T15:10:08.351 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:10:08.352 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:10:08.352 INFO:teuthology.orchestra.run.trial068.stderr: 91.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50638.log 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50638.log.gz 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49883.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-25T15:10:08.367 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5/var/log/ceph/ceph-client.admin.52304.log: --verbose -- /var/log/ceph/ceph-client.admin.49335.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51975.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52500.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49335.log: /var/log/ceph/ceph-client.admin.51975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49335.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51975.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52500.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50523.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52500.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-osd.0.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49866.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49866.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50523.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51685.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49866.log.gz 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52892.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.45228.log: /var/log/ceph/ceph-client.admin.51685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51457.log 2026-02-25T15:10:08.368 INFO:teuthology.orchestra.run.trial021.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52892.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.51685.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52892.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50602.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51457.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49286.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50602.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50728.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52794.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51881.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52794.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50728.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50340.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51881.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52794.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49221.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51881.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49221.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50340.log.gz 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51238.log 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52990.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.49221.log.gz --verbose 2026-02-25T15:10:08.369 INFO:teuthology.orchestra.run.trial021.stderr: -- /var/log/ceph/ceph-client.admin.52647.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53872.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52647.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.51238.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51678.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52647.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52598.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51678.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53872.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53578.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52598.log: gzip -5 --verbose -- 87.0% /var/log/ceph/ceph-client.admin.53186.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51678.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53578.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52598.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54164.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53578.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53921.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.54164.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53186.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54164.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53921.log.gz 2026-02-25T15:10:08.370 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50308.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49886.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49433.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51489.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49433.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49886.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51489.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49433.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51489.log.gz 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-25T15:10:08.371 INFO:teuthology.orchestra.run.trial021.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/valgrind/osd.12.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51687.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51363.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51364.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51363.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51687.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54117.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51364.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51363.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52072.log 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51364.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2026-02-25T15:10:08.372 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.54117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50633.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54117.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52072.log: /var/log/ceph/ceph-client.admin.52451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52072.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45519.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49842.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50633.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49872.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53333.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.45519.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip/var/log/ceph/ceph-client.admin.49872.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52177.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45519.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53333.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49872.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53333.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53676.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52177.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53627.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53676.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53627.log: /var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-osd.4.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53627.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2026-02-25T15:10:08.373 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52745.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52549.log: /var/log/ceph/ceph-client.admin.52745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49854.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52745.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.45496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53039.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50635.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49854.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51909.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53039.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.51909.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.45565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49061.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52226.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip/var/log/ceph/ceph-client.admin.49061.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51595.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph.audit.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49061.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52843.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51595.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2026-02-25T15:10:08.374 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51118.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52402.log: /var/log/ceph/ceph-client.admin.53137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51118.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51118.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53431.log: /var/log/ceph/ceph-client.admin.47352.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53235.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.47352.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53970.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53235.log: /var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49384.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53235.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53970.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49881.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53970.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51151.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52353.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49384.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 91.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49860.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49881.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52353.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51151.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49884.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51460.log 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52353.log.gz 2026-02-25T15:10:08.375 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49860.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52696.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49884.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51834.log: 85.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.51460.log.gz -5 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50607.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50607.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52696.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53823.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50607.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53529.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53774.log: /var/log/ceph/ceph-client.admin.53823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52941.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53823.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.52941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51565.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53529.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52941.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.51565.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50640.log 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2026-02-25T15:10:08.376 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50399.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50399.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50640.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53088.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50637.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50399.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51050.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53088.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53725.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53088.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51050.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54019.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53725.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.54019.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51287.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38770.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54019.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph.tmp-client.admin.38770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49851.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38770.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 90.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53284.log 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51287.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.49851.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2026-02-25T15:10:08.377 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45121.log 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53382.log 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49851.log.gz 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.45121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51125.log 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.53284.log.gz 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.53382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54068.log 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.45121.log.gz 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.51125.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53382.log.gz 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr:/var/log/ceph/ceph-client.admin.54068.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51125.log.gz 2026-02-25T15:10:08.378 INFO:teuthology.orchestra.run.trial021.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54068.log.gz 2026-02-25T15:10:08.386 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50426.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52292.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.52292.log: /var/log/ceph/ceph-client.admin.51616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49564.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50228.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49691.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49691.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.52292.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51431.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.49564.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51561.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.52290.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51561.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50228.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51561.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49711.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.51431.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.50426.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45537.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50298.log 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2026-02-25T15:10:08.387 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45537.log: /var/log/ceph/ceph-client.admin.50298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50306.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45537.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44790.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50237.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.44790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49786.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44790.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip/var/log/ceph/ceph-client.admin.45113.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45349.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49786.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50453.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49711.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.50306.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-osd.7.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45349.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45584.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54821.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49786.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45255.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50205.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50237.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.54821.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50453.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50205.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/valgrind/osd.7.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50298.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-25T15:10:08.388 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/valgrind/osd.11.log: 65.9% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45443.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54821.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50205.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50057.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50002.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50057.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45443.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58777.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50498.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.58777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50321.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50321.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54820.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58777.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50321.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.54820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50236.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.44942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52291.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50236.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54818.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50236.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.52291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49632.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.54818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.54820.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50002.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.52291.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49501.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2026-02-25T15:10:08.389 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50115.log/var/log/ceph/ceph-client.admin.49954.log: 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50498.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54818.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50391.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49542.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.50115.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49632.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.58775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51430.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58776.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.58776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49852.log: -- /var/log/ceph/ceph-client.admin.51615.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49653.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51615.log: gzip 90.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz -- 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: /var/log/ceph/ceph-client.admin.54819.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49653.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51615.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51430.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51560.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.54819.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.58776.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49907.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.51560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44848.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45208.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.44848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49525.log 2026-02-25T15:10:08.390 INFO:teuthology.orchestra.run.trial072.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54819.log.gz 2026-02-25T15:10:08.392 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50076.log 2026-02-25T15:10:08.392 INFO:teuthology.orchestra.run.trial072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44848.log.gz 2026-02-25T15:10:08.392 INFO:teuthology.orchestra.run.trial072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51560.log.gz 2026-02-25T15:10:08.392 INFO:teuthology.orchestra.run.trial072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45208.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49598.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49525.log: /var/log/ceph/ceph-client.admin.50076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45396.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.49598.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54822.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45396.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:gzip/var/log/ceph/ceph-mgr.x.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50519.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.54822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44895.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45490.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.44895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50341.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.45490.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44895.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: -- /var/log/ceph/ceph-client.admin.50272.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.49542.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.45490.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50341.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54822.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51614.log 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr:/var/log/ceph/ceph-client.admin.50272.log: /var/log/ceph/ceph-osd.15.log: /var/log/ceph/ceph-client.admin.51614.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50272.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49525.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.50076.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50519.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49907.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.51614.log.gz 2026-02-25T15:10:08.393 INFO:teuthology.orchestra.run.trial072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2026-02-25T15:10:08.394 INFO:teuthology.orchestra.run.trial072.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2026-02-25T15:10:08.400 INFO:teuthology.orchestra.run.trial072.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.50057.log.gz 2026-02-25T15:10:08.403 INFO:teuthology.orchestra.run.trial072.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2026-02-25T15:10:08.404 INFO:teuthology.orchestra.run.trial072.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.50341.log.gz 2026-02-25T15:10:08.410 INFO:teuthology.orchestra.run.trial072.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2026-02-25T15:10:08.412 INFO:teuthology.orchestra.run.trial072.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.49691.log.gz 2026-02-25T15:10:08.413 INFO:teuthology.orchestra.run.trial072.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2026-02-25T15:10:08.464 INFO:teuthology.orchestra.run.trial072.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-25T15:10:08.870 INFO:teuthology.orchestra.run.trial072.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49653.log.gz 2026-02-25T15:10:08.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-25T15:10:08.975 INFO:teuthology.orchestra.run.trial031.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-25T15:10:08.981 INFO:teuthology.orchestra.run.trial021.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-25T15:10:09.039 INFO:teuthology.orchestra.run.trial021.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-25T15:10:09.048 INFO:teuthology.orchestra.run.trial021.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-25T15:10:09.061 INFO:teuthology.orchestra.run.trial068.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-25T15:10:09.078 INFO:teuthology.orchestra.run.trial031.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-25T15:10:09.088 INFO:teuthology.orchestra.run.trial031.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-25T15:10:09.112 INFO:teuthology.orchestra.run.trial031.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-25T15:10:09.114 INFO:teuthology.orchestra.run.trial031.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-25T15:10:09.116 INFO:teuthology.orchestra.run.trial031.stderr: 2026-02-25T15:10:09.116 INFO:teuthology.orchestra.run.trial031.stderr:real 0m0.799s 2026-02-25T15:10:09.116 INFO:teuthology.orchestra.run.trial031.stderr:user 0m3.573s 2026-02-25T15:10:09.116 INFO:teuthology.orchestra.run.trial031.stderr:sys 0m0.179s 2026-02-25T15:10:09.126 INFO:teuthology.orchestra.run.trial068.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-25T15:10:09.127 INFO:teuthology.orchestra.run.trial021.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-25T15:10:09.142 INFO:teuthology.orchestra.run.trial072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-25T15:10:09.142 INFO:teuthology.orchestra.run.trial068.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-25T15:10:09.148 INFO:teuthology.orchestra.run.trial021.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-25T15:10:09.150 INFO:teuthology.orchestra.run.trial021.stderr: 2026-02-25T15:10:09.150 INFO:teuthology.orchestra.run.trial021.stderr:real 0m0.836s 2026-02-25T15:10:09.150 INFO:teuthology.orchestra.run.trial021.stderr:user 0m3.534s 2026-02-25T15:10:09.150 INFO:teuthology.orchestra.run.trial021.stderr:sys 0m0.252s 2026-02-25T15:10:09.158 INFO:teuthology.orchestra.run.trial072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-25T15:10:09.173 INFO:teuthology.orchestra.run.trial072.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-25T15:10:09.230 INFO:teuthology.orchestra.run.trial068.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-25T15:10:09.366 INFO:teuthology.orchestra.run.trial072.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-25T15:10:09.368 INFO:teuthology.orchestra.run.trial072.stderr: 2026-02-25T15:10:09.368 INFO:teuthology.orchestra.run.trial072.stderr:real 0m1.010s 2026-02-25T15:10:09.368 INFO:teuthology.orchestra.run.trial072.stderr:user 0m4.005s 2026-02-25T15:10:09.368 INFO:teuthology.orchestra.run.trial072.stderr:sys 0m0.251s 2026-02-25T15:10:09.395 INFO:teuthology.orchestra.run.trial068.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-25T15:10:09.396 INFO:teuthology.orchestra.run.trial068.stderr: 2026-02-25T15:10:09.397 INFO:teuthology.orchestra.run.trial068.stderr:real 0m1.068s 2026-02-25T15:10:09.397 INFO:teuthology.orchestra.run.trial068.stderr:user 0m4.094s 2026-02-25T15:10:09.397 INFO:teuthology.orchestra.run.trial068.stderr:sys 0m0.188s 2026-02-25T15:10:09.398 INFO:tasks.ceph:Archiving logs... 2026-02-25T15:10:09.399 DEBUG:teuthology.misc:Transferring archived files from trial021:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial021/log 2026-02-25T15:10:09.400 DEBUG:teuthology.orchestra.run.trial021:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:10:09.867 DEBUG:teuthology.misc:Transferring archived files from trial031:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial031/log 2026-02-25T15:10:09.867 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:10:10.209 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial068/log 2026-02-25T15:10:10.211 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:10:10.607 DEBUG:teuthology.misc:Transferring archived files from trial072:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial072/log 2026-02-25T15:10:10.608 DEBUG:teuthology.orchestra.run.trial072:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T15:10:11.031 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T15:10:11.042 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-25T15:10:11.043 DEBUG:teuthology.orchestra.run.trial021:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:10:11.045 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:10:11.046 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:10:11.048 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T15:10:11.301 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-25T15:10:11.312 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-25T15:10:11.313 DEBUG:teuthology.orchestra.run.trial021:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:10:11.315 DEBUG:teuthology.orchestra.run.trial031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:10:11.316 DEBUG:teuthology.orchestra.run.trial068:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:10:11.318 DEBUG:teuthology.orchestra.run.trial072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T15:10:11.329 INFO:teuthology.orchestra.run.trial021.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:10:11.331 INFO:teuthology.orchestra.run.trial031.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:10:11.333 INFO:teuthology.orchestra.run.trial068.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:10:11.335 INFO:teuthology.orchestra.run.trial072.stderr:bash: line 1: ntpq: command not found 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:=============================================================================== 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:^- callisto.psychotron.org 2 8 377 63 +742us[ +742us] +/- 43ms 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:^+ time.cloudflare.com 3 9 377 386 +123us[ +187us] +/- 6892us 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:^* time.cloudflare.com 3 9 377 386 +158us[ +222us] +/- 6820us 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial068.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 768 -6179us[-6045us] +/- 77ms 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:=============================================================================== 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:^- callisto.psychotron.org 2 7 367 52 +558us[ +558us] +/- 44ms 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:^* time.cloudflare.com 3 8 377 57 -76us[ -83us] +/- 6796us 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:^+ time.cloudflare.com 3 7 377 123 -64us[ -71us] +/- 7153us 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial031.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 248 -3026us[-3032us] +/- 81ms 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:10:11.439 INFO:teuthology.orchestra.run.trial072.stdout:=============================================================================== 2026-02-25T15:10:11.440 INFO:teuthology.orchestra.run.trial072.stdout:^- callisto.psychotron.org 2 7 367 66 +511us[ +511us] +/- 43ms 2026-02-25T15:10:11.440 INFO:teuthology.orchestra.run.trial072.stdout:^+ time.cloudflare.com 3 9 377 378 -61us[ -61us] +/- 6993us 2026-02-25T15:10:11.440 INFO:teuthology.orchestra.run.trial072.stdout:^* time.cloudflare.com 3 9 377 384 -69us[ -109us] +/- 6448us 2026-02-25T15:10:11.440 INFO:teuthology.orchestra.run.trial072.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 125 -3007us[-3007us] +/- 81ms 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:=============================================================================== 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:^- time-h.den.codehof.net 2 6 377 53 -3665us[-3665us] +/- 52ms 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:^+ time.cloudflare.com 3 9 377 248 -273us[ -381us] +/- 6985us 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:^* time.cloudflare.com 3 8 377 190 -224us[ -335us] +/- 6883us 2026-02-25T15:10:11.442 INFO:teuthology.orchestra.run.trial021.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 382 -3441us[-3544us] +/- 80ms 2026-02-25T15:10:11.442 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-25T15:10:11.454 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-25T15:10:11.455 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-25T15:10:11.468 DEBUG:teuthology.orchestra.run.trial021:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:10:11.536 DEBUG:teuthology.orchestra.run.trial031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:10:11.591 DEBUG:teuthology.orchestra.run.trial068:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:10:11.646 DEBUG:teuthology.orchestra.run.trial072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T15:10:11.702 DEBUG:teuthology.orchestra.run.trial021:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:10:11.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:11.731 DEBUG:teuthology.orchestra.run.trial031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:10:11.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:11.759 DEBUG:teuthology.orchestra.run.trial068:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:10:11.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:11.788 DEBUG:teuthology.orchestra.run.trial072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-25T15:10:11.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:11.817 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-25T15:10:11.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-25T15:10:11.850 INFO:teuthology.task.internal:Duration was 3216.222053 seconds 2026-02-25T15:10:11.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-25T15:10:11.869 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-25T15:10:11.869 DEBUG:teuthology.orchestra.run.trial021:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:10:11.872 DEBUG:teuthology.orchestra.run.trial031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:10:11.875 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:10:11.878 DEBUG:teuthology.orchestra.run.trial072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T15:10:11.907 INFO:teuthology.orchestra.run.trial021.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:10:11.910 INFO:teuthology.orchestra.run.trial031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:10:11.913 INFO:teuthology.orchestra.run.trial068.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:10:11.915 INFO:teuthology.orchestra.run.trial072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T15:10:12.381 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-25T15:10:12.381 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial021.front.sepia.ceph.com 2026-02-25T15:10:12.381 DEBUG:teuthology.orchestra.run.trial021:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:10:12.403 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial031.front.sepia.ceph.com 2026-02-25T15:10:12.403 DEBUG:teuthology.orchestra.run.trial031:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:10:12.423 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial068.front.sepia.ceph.com 2026-02-25T15:10:12.423 DEBUG:teuthology.orchestra.run.trial068:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:10:12.442 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial072.front.sepia.ceph.com 2026-02-25T15:10:12.443 DEBUG:teuthology.orchestra.run.trial072:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T15:10:12.463 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-25T15:10:12.463 DEBUG:teuthology.orchestra.run.trial021:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.466 DEBUG:teuthology.orchestra.run.trial031:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.468 DEBUG:teuthology.orchestra.run.trial068:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.485 DEBUG:teuthology.orchestra.run.trial072:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.566 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-25T15:10:12.566 DEBUG:teuthology.orchestra.run.trial021:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:12.569 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:12.572 DEBUG:teuthology.orchestra.run.trial068:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:12.574 DEBUG:teuthology.orchestra.run.trial072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T15:10:12.590 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:10:12.592 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:10:12.592 INFO:teuthology.orchestra.run.trial021.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:10:12.592 INFO:teuthology.orchestra.run.trial021.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.592 INFO:teuthology.orchestra.run.trial021.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:10:12.593 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:10:12.594 INFO:teuthology.orchestra.run.trial031.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:10:12.594 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.594 INFO:teuthology.orchestra.run.trial031.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:10:12.594 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:10:12.594 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:10:12.595 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:10:12.595 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.596 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:10:12.596 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:10:12.597 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T15:10:12.598 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T15:10:12.599 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T15:10:12.599 INFO:teuthology.orchestra.run.trial072.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T15:10:12.599 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T15:10:12.602 INFO:teuthology.orchestra.run.trial021.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:10:12.604 INFO:teuthology.orchestra.run.trial031.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:10:12.606 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:10:12.609 INFO:teuthology.orchestra.run.trial072.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T15:10:12.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-25T15:10:12.628 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-25T15:10:12.628 DEBUG:teuthology.orchestra.run.trial021:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:10:12.668 DEBUG:teuthology.orchestra.run.trial031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:10:12.693 DEBUG:teuthology.orchestra.run.trial068:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:10:12.719 DEBUG:teuthology.orchestra.run.trial072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T15:10:12.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-25T15:10:12.763 DEBUG:teuthology.orchestra.run.trial021:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.766 DEBUG:teuthology.orchestra.run.trial031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.768 DEBUG:teuthology.orchestra.run.trial068:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.769 DEBUG:teuthology.orchestra.run.trial072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.788 INFO:teuthology.orchestra.run.trial021.stdout:kernel.core_pattern = core 2026-02-25T15:10:12.791 INFO:teuthology.orchestra.run.trial031.stdout:kernel.core_pattern = core 2026-02-25T15:10:12.792 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern = core 2026-02-25T15:10:12.809 INFO:teuthology.orchestra.run.trial072.stdout:kernel.core_pattern = core 2026-02-25T15:10:12.827 DEBUG:teuthology.orchestra.run.trial021:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:12.861 DEBUG:teuthology.orchestra.run.trial031:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:12.878 DEBUG:teuthology.orchestra.run.trial068:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:12.896 DEBUG:teuthology.orchestra.run.trial072:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T15:10:12.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T15:10:12.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-25T15:10:12.929 INFO:teuthology.task.internal:Transferring archived files... 2026-02-25T15:10:12.931 DEBUG:teuthology.misc:Transferring archived files from trial021:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial021 2026-02-25T15:10:12.931 DEBUG:teuthology.orchestra.run.trial021:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:10:12.969 DEBUG:teuthology.misc:Transferring archived files from trial031:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial031 2026-02-25T15:10:12.969 DEBUG:teuthology.orchestra.run.trial031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:10:13.007 DEBUG:teuthology.misc:Transferring archived files from trial068:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial068 2026-02-25T15:10:13.008 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:10:13.045 DEBUG:teuthology.misc:Transferring archived files from trial072:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-25_14:08:21-rados-tentacle-distro-default-trial/70208/remote/trial072 2026-02-25T15:10:13.045 DEBUG:teuthology.orchestra.run.trial072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T15:10:13.105 INFO:teuthology.task.internal:Removing archive directory... 2026-02-25T15:10:13.106 DEBUG:teuthology.orchestra.run.trial021:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:10:13.109 DEBUG:teuthology.orchestra.run.trial031:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:10:13.112 DEBUG:teuthology.orchestra.run.trial068:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:10:13.114 DEBUG:teuthology.orchestra.run.trial072:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T15:10:13.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-25T15:10:13.154 INFO:teuthology.task.internal:Not uploading archives. 2026-02-25T15:10:13.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-25T15:10:13.173 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-25T15:10:13.173 DEBUG:teuthology.orchestra.run.trial021:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:10:13.176 DEBUG:teuthology.orchestra.run.trial031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:10:13.178 DEBUG:teuthology.orchestra.run.trial068:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:10:13.180 DEBUG:teuthology.orchestra.run.trial072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T15:10:13.190 INFO:teuthology.orchestra.run.trial021.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:10 /home/ubuntu/cephtest 2026-02-25T15:10:13.192 INFO:teuthology.orchestra.run.trial031.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:10 /home/ubuntu/cephtest 2026-02-25T15:10:13.194 INFO:teuthology.orchestra.run.trial068.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:10 /home/ubuntu/cephtest 2026-02-25T15:10:13.196 INFO:teuthology.orchestra.run.trial072.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 15:10 /home/ubuntu/cephtest 2026-02-25T15:10:13.197 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-25T15:10:13.214 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-25T15:10:13.256 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 3216.222053050995 failure_reason: '"2026-02-25T15:02:26.836819+0000 mon.c (mon.2) 473 : cluster [WRN] Health check failed: 1 network partition detected (MON_NETSPLIT)" in cluster log' flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: false 2026-02-25T15:10:13.256 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T15:10:13.373 INFO:teuthology.run:FAIL